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(54) PATTERN DATA GENERATOR, PATTERN DATA GENERATING METHOD, AND ITS MEDIUM 

(57) An image of an object seen from any viewpoint 
is provided in a readily understandable state by an 
attention function. The user uses a mouse to set the 
operating mode to "Navigate" and clicks on the object 
desired to be viewed by the left button of the mouse to 
place it in the selected state. A model editing tool 420 
makes the background of a panel for display of the posi- 
tion of the viewpoint yellow and moves the object to the 
center of an editing window in response to an operation 
for selecting "Attention ON" by operation of the right but- 
ton of the mouse. The model editing tool 420 displays 
an object from any viewpoint in response to a drag oper- 
ation by a user by a mouse. The object can be observed 
until "Attention OFF" is instructed by the operation of the 
right button of the mouse. 
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Description 

TECHNICAL FIELD 

[0001 ] The present invention relates to a graphic data generating apparatus, a graphic data generation method, and 
a medium for the same, more particularly relates to a graphic data generating apparatus, a graphic data generation 
method and a medium for the same able to be used for comprehensive editing of a script etc. activated in accordance 
with an operation of a client (user) with respect to a shape and position of a three-dimensional graphic able to be used 
for expression of an object in a three-dimensional virtual space and with respect to a displayed three-dimensional 

[0002] More specifically, the present invention relates to an attention function. The "attention function" is used for con- 
firming the shapes of objects displayed in a "3D View" window and arranges and displays objects seen from, any view- 
point designated by a user in the correct preparation software 4 around any of one or more objects selected by the user 
by a mouse in the "3D View" window. 

BACKGROUND ART 

[0003] As a description language capable of comprehensive handling three-dimensional information using the frame- 
work of the WWW (World Wide Web) providing various types of information on the Internet that globally constructed 
computer network, the VRML (virtual reality modeling language) has been known. 

[0004] First an explanation will be given of the historical background up to the development of the VRML. 
[0005] As an information system able to be used on the Internet, the WWW developed by the Swiss CERN (European 
Center for Nuclear Research) is known. The WWW was designed to enable text, images, sound, and other multimedia 
data to be viewed and heard by a hyper text format and asynchronously transfers to personal computers and other ter- 
minal equipment information stored in WWW servers based on protocol called HTTP (Hyper Text Transfer Protocol). 
The WWW is basically comprised of servers and browsers. 

[0006] A WWW server is comprised of server software known as an HTTP daemon and HTML (Hyper Text Makeup 
Language) files storing hyper text information. A "daemon" is a program which manages and processes information in 

the background when working on UNIX. . 

[0007] Hyper text information is expressed by a description language called the HTML. Hyper text is described by 
HTML by the expression of the logical structure of sentences by format designations known as "tags" surrounded by < 
and ">". Links with other information are described by link information known as "anchors". When designating a location 
of information by anchors, a URL (uniform Resource Locator) is used. 

[0008] The protocol for transferring a f fle described in HTML on a TCP/IP (Transmission Control Protocol/Internet Pro- 
tocol) network is HTTP. HTTP functions to send a request for transfer of information from a client to a WWW server and 
transfer hyper text information of an HTML file to the client. 

[0009] A WWW browser is often used as the environment for uses of the WWW. "Browse" means to freely view. A 
browser executes the work for inquiring about information to a server in accordance with an operation of a user. A 
WWW browser is Netscape Navigator (trademark of Netscape Communications Corporation of the U.S.) and other cli- 
ent software It is possible to use a WWW browser to browse through files, that is, home pages, of WWW servers on 
the globally expanding Internet, corresponding to a URL. and possible to successively follow back linked home pages 
to access various sources of information on the WWW - called "net surfing". 

[001 0] In recent years, the WWW has further expanded. Specif ications for description languages for three-dimen- 
sional graphics called VRML, have been formulated enabling description of three-dimensional spaces and setting 
hyper text links for objects drawn by three-dimensional graphics and enabling successively-access of WWW servers 
while following back the links. VRML browsers are being developed for displaying three-dimensional spaces descnbed 
based on such VRML specif ications. 

[001 1] Details of VRML are described for example in the reference " VRML o Shim: 3-Jigen Denno Kukan no Kochiku 
to Buraujingu (Learn About VRML: Building and Browsing Three-Dimensional Computer Space)", written by Mark 
Pesce translated by Koichi Matsuda. Terunao Kamachi, Shoichi Takeuchi. YKSuaki Honda. Junichi Toshimoto. Masay- 
uki Ishikawa Ken Miyashita. and Kazuhiro Hara. first edition published March 25. 1996. published by Prents Hall. 
ISBN4-931356-37-0 (original work: "VRML: Browsing and Building Cyberspace", Mark Pesce. 1995 New Readers Pub- 
lishing ISBN 1-56205-498-8) and the reference "VRML no Saishin Doko to CyberPassage (Recent Trends in VRML 
and CyberPassage)". Koichi Matsuda and Yasuaki Honda, bit (published by Kyoritsu)/1996. Vol. 28. No. 7. pp. 29 to 36. 
No. 8. pp. 57 to 65, No. 9. pp. 29 to 36. and No. 1 0. pp. 49 to 58). _ _ 

[0012] The formal and complete specifications in The Virtual Reality Modeling Language Version 2.0 . ISO/IEC CD 
14772, August 4, 1996 are disclosed at the following home page address: 
httpy/www.vrrnl.org/SpecificationsA/RML2.0/FINAL/spec/iridex.html 
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[001 3J The Japanese language version is disclosed at the following home page address: 

http://wvw.webcityxojp/info/andoh/vrml2.0/spec-jp /index.html 
[0014] As a VRML 2.0 browser and shared server software, for example, the present applicant, Sony Corporation, 
has developed and is marketing "Community Place (trademark) Browser/Bureau". The p-version (test version) can be 
£ downloaded from the Internet home page http://vs.sony.co. jp). 

[001 51 In the VRML 2.0 t it is possible to describe and express autonomous behavior of an object in a three-dimen- 
sional virtual space. When using VRML 2.0 to prepare VRML content where an object moves around in a three-dimen- 
sional virtual space, normally the following process of work is undergone. Note that below the set of a VRML file, script 
file, etc tor realizing behaviors of a series of objects in a single virtual space is called "VRML content". 

10 

Routine tor Preparing VRML Content 

[001 6J The general routine for preparing VRML content is described below. 
is (1) Preparation of Model 

[0017] The shape, position, etc. of an object (model) arranged in a virtual space are described based on VRML 2.0 
to prepare a basic VRML file. 

20 (2) Desaption of Sensor Node 

[0018] TouchSensors generating events in the case of click operation by a mouse (pointing operation) on objects in 
the virtual space, a T*neSensor generating an event when a predetermined time arrives, and other sensor nodes is 
added to the VRML Me 

25 

(3) Description of Routng 

[001 9] The desapton of the routing tor transmission of events generated in accordance with pointing operations with 
respect to objects to wftch sensor nodes have been added is added to the VRML file. 

30 

(4) Description of Sapt Node 

[0020] The desapbon of a sapt node for transfer of events transmitted by the routing to and from an external script 
is added to the VRM tie 

35 

(5) Preparation of Sapt Frfe 

[0021] A sapt (program) n the Java language (Java is a trademark of Sun Microsystems of the U.S.) for realizing 
predetermined behav»a lor objects in the virtual space based on events transmitted through the saipt node is 

40 described to prepare a sapt tile 

[0022] The desired VRML content is prepared by the process of description of the above (1 ) to (5). 
[0023] When deswog to prepare VRML content accompanying the autonomous behavior of an object in a virtual 
space based on VRML 2 0. an existing authoring software, called a modeler, for example, 3D Studio Max (trademark), 
or other software is used to prepare the shape of the object or animation and output the same in the VRML 2.0 format. 

45 When the modeler does not support the VRML 2.0 format, it is necessary to use a converter etc. to convert to the VRML 
2.0 format. 

[0024] Further, desaptxro ol various sensor nodes etc. defined by the VRML 2.0 are added to the VRML file using 
a text editor, scripts m the Java language are prepared using a text editor, corresponding script nodes are added, routes 
are added, etc. repeatetfy 

so [0025] Finally, when confir mng the actual operation, a VRML browser compatible with VRML 2.0 is activated and the 
behavior of the object is confirmed by a click operation by a mouse etc. 

[0026] This method of preparing VRML content features an extremely large amount of complicated work and remark- 
ably poor work efficiency For example, when adding a field to a script node, it is necessary to revise both the script file 
and the VRML file. Further, it is necessary to maintain a match between the two. 
55 [0027] When designating routing of an event as well, further, it is necessary to ensure a match of the type of the event 
(format of data). If the format of desaipbon of the event etc. is mistaken, when reading by a VRML browser, a compo- 
sition error will arise and it is necessary to again revise the file. Further, each time a node is added, re-reading by the 
VRML browser is necessary, so the work efficiency is extremely poor. 
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[0028] Points have been found in the performance of the interactive operation in the conventional method which 
should be improved. One example of a defect in the interaction is the trouble and inefficiency of the confirmation oper- 
ation when preparing a world. Figure 1 is a flow chart of the routine of a conventional method of preparation of a world. 
The production of the world is classified the two. In the first, the model is produced, and in the second, the interaction 
5 is produced. Details will be discussed later in comparison with embodiments of the present invention, but while confir- 
mation is necessary when preparing a world, in the convention method of preparation shown in Fig. 1 , as illustrated at 
step 108, it is necessary to use a browser. 

[0029] Further, in the past, the attention function was insufficient. The "attention function" is used for confirming the 
shapes of objects displayed in a "3D View" window and arranges and displays objects seen from any viewpoint desig- 
io nated by a user in the content preparation software 4 around any of one or more objects selected by the user by a 
mouse in the "3D View" window. 

DISCLOSURE OF THE INVENTION 

is [0030] An object of the present invention is to realize a desirable attention function. 

[0031 ] According to a first aspect of the present invention, there is provided a graphic data generating apparatus com- 
prising a displaying means for displaying a three-dimensional object in an editing window; an instructing means for giv- 
ing an operation instruction for an object displayed by said displaying means; and an attention processing means, 
wherein the attention processing means enters an attention mode in response to a first predetermined operation 

20 instruction, selects an object selected by the instructing means, and displays the selected object moved to the center 
of the editing window to enable the selected object to be viewed from any viewpoint. 

[0032] Preferably, the attention processing means ends its operation in response to a second predetermined opera- 
tion instruction. 

[0033] Specifically, the attention processing means is executed by an editing means for preparing content. 
25 [0034] Further, according to a second aspect of the present invention, there is provided a graphic data generating 
method which changes to an attention mode in response to a first predetermined operation instruction, selects an 
object in accordance with a selection, and displays the selected object moved to the center of an editing window to ena- 
ble the selected object to be viewed from any viewpoint. 

[0035] Preferably, the attention mode is ended in response to a second predetermined operation instruction. 

30 [0036] Further, according to a third aspect of the present invention, there is provided a medium for mediating a pro- 
gram for executing the above graphic data generating method. That is. according to the present invention, there is pro- 
vided a medium for mediating a program which prepares content in a three-dimensional virtual space by an interactive 
manner with a displaying means displaying a three-dimensional object in an editing window, which changes to an atten- 
tion mode in response to a first predetermined operation instruction, selects an object in accordance with a selection, 

35 and displays the selected object moved to the center of an editing window to enable the selected object to be viewed 
from any viewpoint. 

[0037] The program is executed in a computer system or is transferred through a network including a server appara- 
tus. 

40 BRIEF DESCRIPTION OF THE DRAWINGS 

[0038] The above objects and features and other objects and features of the present invention will become clearer 
from the following description given with reference to the attached drawings, in which: 

45 Fig. 1 is a flow chart of the method of preparation of VRML content; 

Fig. 2 is a view of the configuration of a network system comprehensively handling a three-dimensional virtual 

space to which a graphic data generating apparatus of the present invention is applied; 

Fig. 3 is a view of the configuration of a content preparation software tool of the present invention; 

Fig. 4 is a flow chart of the method of preparation of VRML content executed by the content preparation software 
so tool illustrated in Fig. 3; 

Fig. 5 is a flow chart illustrating the processing of a basic confirmation operation in the process of preparation of 

the VRML content illustrated in Fig. 4; 

Fig. 6 is a flow chart illustrating the processing of a suitable confirmation operation in the process of preparation of 
the VRML content illustrated in Fig. 4; 
55 Fig. 7 is a view of the configuration of a computer system in the network shown in Fig. 2; 

Fig. 8 is a view of the configuration of a content preparation software tool according to an embodiment of the con- 
tent preparation software tool illustrated in Fig. 3; 

Fig. 9 shows windows displayed by a graphical interface portion of a content preparation software tool of Fig. 8 in 
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a display device in a computer system; 

Fig. 10A to Fig. 10C are enlarged views of the CONDUCTOR window illustrated in Fig. 9; 

Fig. 11 is a view of an example of the display of a 3D VIEW window (editing window) illustrated in Fig. 9; 

Fig. 12 to Fig. 14 are views of the graphic of POINT OF INTEREST in a window of a screen of a display device; 
£ Fig. 15 is a flow chart of the processing for displaying and setting regions of the sensor node; 

Fig. 16 and Fig. 17 are views of examples of display by a PARALLEL VIEW function; 

Fig. 18 to Fig. 22 are views of examples of display by an ATTENTION function; 

Fig. 23 is a flow chart of the processing of an ATTENTION function; 

Fig. 24 is a flow chart of a routing editing processing; 
io Fig. 25 to Fig. 27 are views of examples of display in routing editing processing; 

Fig. 28 shows an example of the display of an object for preparing VRML content; 

Fig. 29 is a flow chart of the processing for preparing first VRML content; 

Fig. 30 to Fig. 34 show examples of the display in a window when preparing first VRML content; 

Fig. 35 is a flow chart of the processing for preparing second VRML content; 
is Fig. 36 and Fig. 37 show examples of the display in a window when preparing second VRML content; 

Fig. 38 to Fig. 44 show examples of the display in a window when preparing second VRML content; 

Fig. 45 is a flow chart of the processing for preparing third VRML content; and 

Fig. 46 to Fig. 49 show examples of the display in a window when preparing third VRML content. 



20 BEST MODE FOR CARRYING OUT THE INVENTION 



[0039] Embodiments of the graphic data generating apparatus, graphic data generating method, and medium for 
mediating a program for executing the graphic data generating method will be explained next. 

25 Network System 



[0040] Figure 2 is a view of the configuration of a network system 1 for comprehensively handling a three-dimensional 

virtual space according to one example of application of the graphic data generating apparatus, graphic data generating 

method, and medium of the present invention. 
30 [0041] The network system 1 is constituted by an in-house network 10, an Internet system 12, an Internet provider 

14, an ISDN (integrated services digital network) net 16, and a client (subscriber) system 2 connected to each other. 

[0042] The network system 1 may have a plurality of in-house networks 1 0, Internet systemsl 2, internet providers 1 4, 

client systems 2, etc., but for simplification of illustration, in Fig. 2, just one of each of them is illustrated. 

[0043] The in-house network 10 is constituted by a hard disk drive 100. a server apparatus 102. a LAN (local area 
35 network) 104. and a gateway server (GWS) 106. 

[0044] The Internet system 12 connected to the in-house network 10 is constituted by router devices 120 and 124 

and a digital communications line 122. 

[0045] An Internet provider 14 is provided between the Internet system 12 and the ISDN net 16. 
[0046] In the network system 1 shown in Fig. 2, the in-house network 1 0 and the client (subscriber) system 2 are con- 
40 nected through the Internet system 12, the Internet provider 14, and the ISDN net 16. In this specification, the LAN 104, 
Internet system 12, Internet provider 14, and ISDN net 16 are referred to as the "network". This network transfers data 
between the server apparatus 102 and the client system 2. 

[0047] The client system 2 connected to the ISDN net 1 6 is constituted by a computer system having a personal com- 
puter (PC) 20, a display device (DSP) 24, and an input device (IN) 26. A storage device 28 is connected to the computer 
45 system. As the computer system, however, while the display device 24, input device 26, and external storage device 28 
connected to the personal computer (PC) 20 constitute part of the computer system, they may be provided externally 
as well. In the present embodiment, the explanation will be made of the case where the display device 24 and input 
device 26 constitute part of the computer system, while the external storage device 28 is provided outside the computer 
system. 

50 

Server Apparatus 102 



[0048] The server apparatus 102 of the in-house network 10 is a server apparatus such as the "Community Place" 
(trademark) (for example, http://vs.sony.co.jp/) which acquires through the network etc. VRML content, that is, VRML 
55 content comprised of a VRML file showing the shape and position of a three-dimensional object described by the user 
by VRML 2.0 and a script file described by the user by the Java language or other programming language and activated 
in accordance with an operation by the user on the object, stores the same in the hard disk drive 1 00. and manages the 
results of the storage. 
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[0049] Below, the set of the VRML file (extension.wri), the script file in the Java language (extension Java), etc. will be 
called the VRML content. 

[0050] The server device 102 sends the VRML content of the three<limensional virtual space stored in the hard disk 
drive 100 to the client system 2 via the server apparatus 102, LAN 104, Internet system 12, Internet provider 14, and 
5 ISDN net 1 6 (hereinafter these communication nodes in the network system 1 will be also simply referred to all together 
as the "network") and displays the same on the display device 24. 

[0051] Further, the server apparatus 102, in response to a request of the client system 2, transfers a content prepa- 
ration software tool, that is, a program, stored in for example the hard disk drive 100 through the network to the client 
system 2 Alternatively, it may distribute a content preparation software tool, that is, a program, to the client system 2 in 
io a state stored m a floppy disk 280 or a magneto-optic disk 282. 

Explanation of Medium tor Program 

[0052] As the graphic data generation apparatus, graphic data generation method, and medium for the program for 
15 executing the method of the present invention, the following explanation will be made mainly of the configuration and 
operation at the client system 2, but the "medium" in the present invention not only includes a recording medium storing 
a computer program lor realizing the graphic data generation method of the present invention, but does not merely 
mean a program storing medium and also means a program transmission medium when downloading to the client (sub- 
scriber) system 2 descrtoed in detail in the following embodiments a computer program through the network system 1 
20 of Fig. 2 for the ckent system 2 to realize the graphic data generation method of the present invention. The reason is 
that as clear from the following explanation, when working the graphic data generation method of the present invention, 
it is possible to reakz* certain processing at any location without the restrictions of concentration. The present invention 
can be also realized by a tocahzation. 

[0053] Figure 3 is a view of a graphic data generation method and graphic data generation apparatus, in particular a 
25 content preparation software tool 3 (Community Place (trademark) Conductor), of the present invention in a client (sub- 
scriber) system 2 The content preparabon software tool 3 has a graphical user interface (GUI) 31 , object manager 32, 
Java compiler 33. scene graph manager 34, Java VM 346, purser 34C. HTML browser 35, and backup manager 36. 
[0054] The graprtcal user rtedace portion 31 performs a variety of window displays. 

[0055] The Java compter 33. an externa) program, compiles Java programs. The scene graph manager 34 is a portion 
30 common with the browser The scene graph manager 34A handles the hierarchical structure of the VRML nodes. The 
purser 34C analyzes the VRML file The Java VM34B executes the script described by Java. 

[0056] The HTML browser 35. an external program, is used for displaying an anchor node or displaying a help file of 
a VRML node descrfced by the HTML format. 

[0057] The portion 34 comprised of the scene graph manager 34A, Java VM 34B, and purser 34C may be used 

35 together with fa example the Community Place (trademark) browser provided by Sony Corporation. 

[0058] The backup manager 36 is enabled when the "Play" button on the screen of the display device is depressed 
by a mouse to enter the "Play" mode and starts preparations for backup of the field values. The stored field values are 
successively reproduced to restore the original screen when the "Stop" button is depressed. That is, the "Conductor" 
content preparation software tool *s designed to enable everything from editing of the world to confirmation of operation. 

40 When the "Play" mode is entered by the user depressing the "Play" button, Conductor starts emulation of a browser. In 
this state, the states of the t*e*ds change, for example, an object starts to move, in accordance with interaction from the 
user. When however the "Stop" button on the screen of the display device is depressed by the mouse to return to the 
"normal editing mode", it rs necessary to return completely to the "state before depressing the Play" button. What are 
necessary at this time are bacfcup of the field values and processing for their restoration. 

45 [0059] The backup manager 36 operates as follows. The backup manager 36 is enabled and starts preparation for 
backup of the field values when the "Play" mode is entered. When the field values are changed for the first time due to 
changes in a moving object etc . the ordinal field values are stored. The field values are stored by the system of suc- 
cessively stacking them (stack system) When the "Stop" button is depressed, the stored values are successively repro- 
duced (the stack is popped) to restore the state of display of the original window. 

so [0060] Like when dividing a ftle into a plurality of files when preparing a large sized program, it is preferable to divide 
a file into a plurality of files when a world has become large to a certain extent. The object manager 32 is the portion for 
managing the consistency n such a case. 

[0061] The route editor (not shown) is used when defining an event between fields using a route text. In the present 
invention, a node is designated using the GUI 31, so there is no longer mistaken designation of names. Further, even 
55 if the user changes the nodes for a route, the route text can be automatically updated without error while the object man- 
ager 32 manages the DEF tor each scope. 

[0062] Script is used to make a more interactive world using Java and other languages, but script is known to be dif- 
ficult to prepare due to the preparation of content In particular, the portion connecting the Java language and VRML is 
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difficult In the present invention, to solve this problem, a Script Expert (not shown), explained in detail later, is provided. 
[0063] Figure 4 is a flow chart of the processing by the content preparation software tool 3. In the present invention, 
the defects of the above mentioned prior art are solved by omitting the manual work and using a GUI 31 to enable the 
work to be efficiently and automatically performed in whole tools. This will be explained briefly below. As explained 
5 above, the content preparation software tool 3 illustrated in Fig. 3 can execute any of the tasks at any portion of the net- 
work 1 , but in the following, for simplification of the explanation, the case of execution mainly in the client system 2 will 
be explained. 

[0064] The substance of the processing of Fig. 4 will be explained first. The processing of the content preparation 
software tool 3 may be roughly divided into (1) initialization, (2) preparation of a model, and (3) preparation of interac- 
w tion. 

[0065] At step 201 , for example, model data is downloaded from the hard disk drive 1 00 to the hard disk drive 21 4 of 
the computer system 20. That is, a model described in VRML 2.0 is loaded in the computer system 20 of the client sys- 
tem 2. As the method of loading, it is possible to download the data from any portion of the network system 1 to the 
computer system 20. 

is [0066] At step 202, the model (object) is edited, for example, the model is rearranged, the attributes are changed, or 
other editing rs performed. 

[0067] At steps 203 to 207, the interaction is prepared. That is, at step 203, sensors are added, at step 204, a script 
node is added, at step 205, Java programs are compiled, and at step 207, routing is edited. 

[0068] At step 208. the operation of the results of the above processing is confirmed by depressing the "Play" button 
?c shown in the "Conductor" window (Fig. 10) of the screen of the display device by a mouse. The confirmation operation 
explained referrng to Fig. 1 is performed by activating a browser after the end of the preparation of the VRML content. 
The operation of step 208 is possible at any time without activating the browser. Details will be given later with reference 
to Fig 5 to Fig 6. but according to the method of the present invention, that is, the content preparation software tool 3, 
if the user depresses the "Play" button, the editing screen, which is the "3D Perspective View" window (editing window) 
25 shown m Ftg 9 etc . that is. is displayed as it is as the substance of the prepared content instead of the display screen 
of the VRML browser 

[0069] Further, the addition of sensors, editing of routing, etc. may be performed by interactive operation by a graph- 
ical user interlace (GUI) 31 in the content preparation software tool 3 of the present embodiment. 
[0070] The content preparation software tool 3 is given the additional function called a Script Expert which prepares 

30 a template of a scrpt by interactive operation and automatically compiles files when the user confirms the operation by r 
an operation Therefore, the content preparation software tool of the present embodiment is given the additional tunc- 1 
bon of automatic corrpilation at the time of confirmation of operation. As a result, the content preparation software tool ^ 
3 of the present embodirnent eliminates the need for performing this work by input of a character string of commands 
(command line) By these functions, it is possible to greatly shorten the time for the user to prepare content of the three- 

3$ dimensional vrtual space by VRML 2.0. 

[0071] In the present invention, the addition of sensors at step 203 can be simply performed by a drag and drop oper- 
ation. 

[0072] Further, in the present invention, the editing of the routing at step 207 can be simply performed using a GUI. 
[0073] Further, m the present invention, there is a function of checking the type of the event even when adding a route 

40 using the route editor and therefore it is possible to prevent the user from designating a mistaken route. 

[0074] In particular, in the present invention, to overcome the disadvantages explained with reference to Fig. 1 , as 
step 208. as explained above and as illustrated in Fig. 5, at any timing and without activating the browser, (1) S211: 
when the "Play" button provided in the screen of the display device is depressed by the user as the predetermined first 
operation. (2) S212; the emulator is activated and it is made possible to confirm the operation at that time by the oper- 

45 ation of the emulator. (3) S213: After the confirmation, when the "Stop" button provided in the screen of the display 
device is depressed by the user as the predetermined second operation, the normal editing mode is returned to. Due 
to this, when adding nodes or making changes in programs for the script nodes simultaneously with normal preparation 
of VRML content, it is possible to use the browser emulator and simply confirm the operation on the spot by just 
depressing the "Play" button. If a compilation error occurs as a result, it is possible to easily detect the error, immedi- 

so ately correct the error, and re-compile the files. 

[0075] In the above confirmation operation, preferably the backup manager 36 is made to operate linked with the 
browser emulator That is, during the confirmation operation of step 208, as illustrated in Fig. 6, (1) S221 : when the user 
depresses the "Play" button as the first predetermined operation, (2) S222: the browser emulator operates in the same 
way as above and the backup manager 36 is enabled and can perform backup. (3) S223: In this state, when for example 

55 a moving object starting to move by being clicked is clicked. (4) S224: the backup manager 36 successively stores the 
field values defining the behavior of motion of the object. (5) S225: If the user depresses the "Stop" button as the sec- 
ond predetermined operation, the confirmation operation ends, but (6) S226: the backup manager 36 successively 
restores the stored field values and resets the field values of the initial state. This enables restoration of the object in 
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the original state before the confirmation operation. These operations may be achieved by just operation of the "Play" 
button and "Stop" button, therefore in addition to the improvement of the operability, the processing time can also be 
shortened. 

5 Client (Subscriber! System 2 and Computer System 20 

[0076] Figure 7 is a view of the configuration of the computer system 20 shown in Fig. 2. In Fig. 7, the external storage 
device 28 illustrated in Fig. 2 is illustrated in detail as the floppy disk (FD) 280 and/or magneto-optical (MO) disk 282, 
while the input device 26 is illustrated as a keyboard (KB) 260 and/or mouse 262. 

10 [0077] In working the invention, the display device 24 may be any color display device suitable for interactive informa- 
tion display and processing linked with a keyboard, mouse, or other data input means, for example, a color CRT display 
device or color liquid crystal display device. Below, in the specification, as the "display device 24", the explanation will 
refer to the case of a color CRT display device or color liquid crystal display device operating linked with a keyboard, 
mouse, or other data input means. 

15 [0078] The computer system 20 is for example a computer designed for multi-media operations and having a com- 
munication function connected to for example the ISDN net 16. It is constituted by a CPU 202, a ROM 204, an input 
interface (IN l/F) 208, a display device 24 controller (DSP-C) 210, a video signal recording RAM (VRAM) 212, a hard 
disk drive (HDD) 214, a floppy disk drive (FDD) 216, an MO disk drive 218, and a line interface 220 connected via a bus 
200. 

20 [0079] The CPU 202 performs various operations explained below by operating various control programs stored in 
the ROM 204 and HDD 214. For example, the CPU 202 displays various image data on the display device 24 through 
the DSP-C 210 and receives as input the data from the KB 260 or data from the mouse 262 through the input interface 
208. The CPU 202 stores the data in a floppy disk 280 serving as the external storage device 28 through the floppy disk 
drive 216 or reads data from the FD 280 or else stores the data in an MO disk 282 serving as the external storage 

25 device 28 through the MO disk drive 218 or reads data from the MO disk 282. The CPU 202 also communicates with 
the ISDN net 16 through the line interface 220. 

[0080] The computer system 20 displays on the display device 24 the image of VRML content of the three-dimen- 
sional virtual space sent from the server apparatus 102 through the network including the ISDN 16 to display it to the 
user (client). 

30 [0081] The computer system 20 installs the content preparation software tool 3 supplied from the server apparatus 
102 via the network or the external storage device 28 in the hard disk drive 214, activates the content preparation soft- 
ware tool 3 in accordance with an operation of the client using the KB 260 or mouse 262 to prepare the VRML content 
of the three-dimensional virtual space, stores this in the hard disk drive 21 4, or uploads this via the network or the exter- 
nal storage device 28 (floppy disk 280 and/or MO disk 282) to the server apparatus 102. 

35 [0082] Further, the computer system 20 changes the displayed color of an object pointed to or changes the substance 
of the display of the object in the three<limensional virtual space in accordance with a pointing operation by the user 
using the input device 26 to an object displayed on the display device 24. 

Display of Three-Dimensional Virtual Space: 

40 

According to the client system 2 having a computer system 20, since it is possible to change the substance of the dis- 
play in the display device 24 interactively in accordance with the operation of the user on an object in a three-dimen- 
sional virtual space, if the client system 2 is used, it is possible to create a realistic feeling where, like reality, the user 
itself makes the object move or touches the object to operate it and make it move or make a sound in a three-dimen- 
45 sional virtual space. 

[0083] Further, the server apparatus 102 obtaining the VRML content of the three-dimensional virtual space from a 
client system 2 through the network stores the VRML content in the hard disk drive 100 and can disclose it to the sub- 
scribers of the Internet through the Internet system 12. When being accessed from a client system 2 through the net- 
work, the server apparatus 102 transfers the VRML content to the client system 2 through the network. 
so [0084] The computer system 20 of the client system 2 displays the three-dimensional virtual space based on the 
VRML content sent from the server apparatus 102 on the display device 24 by a browser. 

[0085] When preparing VRML content of three-dimensional virtual space closed in the client system 2 and not sharing 
the VRML content of the three-dimensional virtual space with other users, it is sufficient to display the prepared VRML 
content as it is on the display device 24 by using the browser. It is not always necessary to transmit the prepared VRML 
55 content to the server apparatus 102. 

[0086] Interaction Pi so lav: The user uses the mouse 262 to point to a desired position on the screen displayed on the 
display device 24 to input operation data for moving an object in a three<Jimensional virtual space or operation input 
data for designating an object in a three-dimensional virtual space. The computer system 20 modifies the content of the 
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three-dimensional virtual space in accordance with the operation data and uses the VRML browser to display the same 
on the display device 24. 

Preferred Embodiments 

5 

[0087] Below, an explanation will be made of preferred embodiments of the present invention. 
[0088] As explained above, in the past, interaction preparation work such as the addition of a sensor to the graphic 
data (VMRL file) of an object and routing was manually carried out by the user (client) using the text editor function, so 
careless mistakes easily occur. Further, it cannot be learned whether or not the result of the interaction preparation 

w. work is correct until the confirmation using the VRML browser shown at step 108 in Fig. 1 , therefore it is necessary to 
activate the VRML browser for confirmation whenever modifying the interaction program, so the work efficiency is low 
and time is taken. This embodiment of the present invention was made so as to link up the operation of the model prep- 
aration and the operation of the interaction preparation editor so as to be able to comprehensively perform this work and 
so as to be able to perform the preparation work of content in the three-dimensional virtual space with a high efficiency 

is and easily in a short time. 

[0089] Figure 8 is a view of the configuration of the content preparation software tool 4 shown as an embodiment of 
the content preparation software tool 3 illustrated in Fig. 3. To perform the model preparation work and the interaction 
preparation work comprehensively and linked with each other, the content preparation software tool 4 comprises a 
graphical user interface (GUI) 40, an editing tool 42, a scene graph data base (SGDB) 44, a working tool 46, a script 

20 preparation unit 47, and a VRML browser 308. 

[0090] The editing tool 42 is constituted by a model editing tool 420, a routing editing tool 422, a scene graph editing 
tool 424, a text editor 426, and a template preparation tool 428. 

[0091 ] The working tool 46 is constituted by a browser emulator 460, a file input/output unit 462, a file scope manage- 
ment unit 464, and & backup restore unit 466. 
25 [0092] The script preparation unit 47 is constituted by a Java emulator 470, a Java debugger 472, and a Java compiler 
474. 

[0093] The content preparation software tool 4 is for example stored in a hard disk drive 100 and input through the 
network system 1 or is stored in the network or an external storage device 28 (floppy disk 280 or MO disk 282) and input 
from the external storage device 28 to the computer system 20 and installed and used in the hard disk drive 214. That 
30 is. in the present embodiment, the example is explained of the case where the content preparation software tool 4 is 
realized in the computer system 20. 

[0094] The constituent parts of the content preparation software tool 4 will be explained below. 
Graphical User Interf ace (GUH 40 

35 

[0095] The graphical user interface (GUI) 40 corresponds to the graphical user interface (GUI) 31 of Fig. 3 and dis- 
plays an image used for the input of various data used for the preparation of VRML content of the three-dimensional 
virtual space through the PC 20 on the display device 24 in the form of a window. 

[0096] Figure 9 is a view of a GUI screen of a first embodiment displayed by the GUI 40 on the display device 24. Trie 
40 GUI screen illustrated in Fig. 9 has a "Conductor" window, "3D Perspective View" window, "Parallel View" window, 
"Resource Library" window, "Scene Graph" window, "World Info" window, "Appearance" window, "Route" window, 
"Attribute" window, "Script Expert" window (not shown), and "Script Editor" window. 

(1) The "Conductor" window is used for management of the Conductor as a whole. 
45 (2) The "3D Perspective View" window is the portion for displaying an image three-dimensionally. In the following, 
the word is simplified as "3D window" for convenience. 

(3) The "Parallel View" window is the portion for displaying an image by a parallel projection. 

(4) The "Resource Library" window is the portion for managing the library. 

(5) The "Scene Graph" window is the portion for displaying the hierarchical tree structure of worlds. 
so (6) The "World Info" window is the portion for setting the attributes of a world. 

(7) The "Appearance" window is the portion for setting the color and texture of an object. 

(8) The "Route" window is the portion for routing an event. 

(9) The "Attribute" window is the portion for setting the attributes of the node and the name of the node. 

(10) The "Script Expert" window is the portion for preparing a template of a script. 
55 (11) The "Script Editor window is the portion of the text editor for editing a Java file. 

[0097] Figure 10A is an enlarged view of the illustrated "Conductor" window, and Fig. 10B and Fig. 10C are enlarged 
views of Fig. 10A. The "Conductor" window is a window for managing the Conductor as a whole. By using the "Conduc- 
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tor" window, it is possible to newly prepare, read in, store, execute, and stop a world, switch the mouse mode, add or 
delete an object, etc. 

(a) By selecting the "New" in the file menu, it is possible to newly prepare a world. 
5 (b) To read a world from a file, the "Open" button is depressed or "Open" is selected from the file menu. 

(c) To store a world in a file, the "Save" button is depressed or "Save" is selected from the file menu. 

(d) To confirm the operation of the world, the "Play" button is depressed. 

(e) By depressing the "Pause" button during play, the play is stopped once. By depressing the "Pause" button again 
or depressing the "Play" button, the play is restarted. The conductor includes a mouse mode illustrated in Fig. 10B 

io as an enlarged view. 

(f) "Navigate (viewpoint motion)" is used when moving the viewpoint in the "2D/3D view" window. 

(g) "Move" is used when moving the object. 

(h) "Rotate" is used when rotating the object. 

(i) "Scale" is used when changing the scale of the object. 

15 

[0098] Further, in the Conductor, a Primitive Bar illustrated enlarged in Fig. 10C is provided: When adding a primitive 
object like a box ch cone, the object desired to be added is selected at the Primitive Bar and the "3D View" window is 
clicked. A "Sensor" is also provided in the Primitive Bar. 

[0099] The GUI 40 receives the operation input data input by the user using the mouse 262 of the input device 26 to 
20 depress various buttons in a window displayed on the display device 24 or using the keyboard 260 and provides the 
required operation data to the tools of the editing tool 42 and the scene graph data base 44. That is, the GUI 40 provides 
a GUI environment to the user. 

[0100] The GUI 40 receives the display output data from the editing tool 42 and the scene graph data base 44 and 
displays the received data in a predetermined window of the display device 24. The constituent parts of the editing tool 
25 42. scene graph data base 44, and working tools 46 are activated in accordance with the operation data input to the 
GUI 40 and performs processing based on the operation data provided from the GUI 40. 

VmLBrowser_30e 

30 [0101] The VRML browser 308 confirms the final substance of the VRML content prepared in the computer system 
20 and displays the VRML content acquired from the server apparatus 102 and in addition displays a help file linked 
with the operation of the constituent parts of the GUI 40 to the working tool 46. As the VRML browser 308 for example, 
it is possible to use the Community Place (trademark) browser provided by Sony Corporation. The Community Place 
browser will be explained as an example below. 

35 

Editing Tool 42 

[0102] The editing tool 42. overall, provides the user with the functions necessary for the preparation of graphic data 
of an object in a three-dimensional virtual space and an interaction program. Below, the parts of the editing tool 42 will 
40 be explained. 

Model Editing Tool 420 

[0103] The processing functions of the model editing tool 420 will be listed below: 

45 

(1) The model editing tool 420 prepares graphic data indicating an attribute such as the size and color (shape) of 
the object, its position, and operation by using the data for the model preparation input by an operation of the user 
with respect to a model editing use window displayed on the display device 24. 

(2) The model editing tool 420 outputs the prepared graphic data (attribute of object) to the scene graph data base 
50 44. 

(3) The model editing tool 420 three-dimensionally displays this at a predetermined position of the model editing 
use window on the display device 24 via the GUI 40. 

(4) The model editing tool 420 may also edit the graphic data read from the hard disk drive 214. 

(5) The model editing tool 420 may also edit the graphic data read from a floppy disk 280 through a floppy disk drive 
55 216 or from an MO disk 282 through an MO disk drive device 218. 

(6) The model editing tool 420 may also edit the graphic data downloaded from the network to the computer system 
20. 
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[0104] The mode! editing tool 420 having the above various functions executes the functions characterizing the 
present invention as explained below: 

a. Object Display Function 

5 Processing for rotation (by "Rotate" operation of "Conductor" window), motion (by "Move" operation of "Con- 

ductor" window), navigation (by "Navigate" operation of "Conductor" window), and scaling (by "Scale" operation of 
"Conductor" window) of object for viewing object from different viewpoints. 

b. Object Scaling Function 

The "Scale" of the "Conductor" window is used. 
10 c. Sensor Node Region Display and Setting Function 

Operates linked with the browser emulator 460. 
d. Parallel View Function 
f. Attention Function 

15 Routing Editing Tool 422 

[0105] The routing editing tool 422 performs the routing editing for establishing correspondence between the graphic 
data of the object named in the current scope (VRML file to be edited) and script and other nodes. Note that, at the time 
of routing, it is necessary to make the format of the field values of the nodes of the origination of routing and the desti- 
ne nation of the routing match, for example, SFBool (Boolean value showing true or false). 

[0106] Note that details of the routing editing processing using the routing editing tool 422 will be described- later as 
the setting of the format of the input data. 

Scene Graph Editing Tool 424 

25 

[0107] In VRML, it is possible to arrange the nodes hierarchically. The scene graph editing tool 424 edits the hierar- 
chical structure of the objects and invisible nodes (script nodes etc.) As the hierarchical structure of the nodes, for 
example, a subnode F1 showing the leaves (VRML file), a subnode F2 showing the branches (VRML file), a subnode 
F3 showing the trunk (VRML file), and a subnode F4 showing the roots (VRML file) comprise hierarchically a main node 
30 F5 showing the tree as a whole (VRML file). 

Text Editor 42$ 

[0108] The text editor 426 has an editor function of a programming language suited to the preparation of a script of 
35 the Java language etc., prepares a source program of the script, and, at the same time, automatically adds, deletes, or 
modifies the variables linked with the editing work on the script node. 

Template Preparation Tool 428 

40 [01 09] The template preparation tool 428 is a tool used for the convenience of the user. It operates linked with the text 
editor 426, prepares a program (template) which becomes the prototype of the script by an interactive manner in 
accordance with the operation of the user with respect to a "Script Expert" window of the display device 24, and outputs 
the same to the text editor 426. The user can easily prepare a script by modifying according to need a source program 
(template of script) which is provided by the template preparation tool 428 and has been already completed to a certain 

45 extent. 

Scene Graph Data Base (SGDB) 44 

[01 1 0] The SGDB 44 stores the data prepared by tools of the editing tool 42 in the RAM 206 of the computer 20, man- 
so ages the stored data, and supplies the stored data immediately in accordance with requests of the constituent parts of 
the editing tool 42 and the working tool 46. 

Working Tool 46 

ss [0111] The working tool 46 provides to the client the functions required for the VRML content preparation work such 
as the confirmation of the prepared content, confirmation of the operation of the script, and the recording and reproduc- 
tion of the data with respect to the input data 26. Below, an explanation will be given of the tools of the working tool 46. 
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Browser Emulator 460 

he e^or 9 460 in accordance with the "Stop" button, the .ater explained backup onager 466 be s,mu.tane- 

ously operated with the browser emulator 460 to restore the original state of display of the object. 

File Input/Ou t put Unit 462 

[01 1 51 The file input/output unit 462 records the graphic data of the VRML content [VRML f to 

graph data base 44. 
Piio ttrnpp Management Unit 464 

F01161 In VRML one scope (range where name and routing attached to the node are valid) is given ^ w fjeof 

referred to whenever referring to a plurality of graphic data f iles with the same nodes. 
Backup Manager 466 

the VRML file) from the scene graph data base 44 when the browser emulator 460 .s activated in accordance with 

£ when ££££ SEZr 460 stops opera^ng in accordance with depression of the "Stop" button of the "Conduc 

^P'ays the original three-dimensional virtual space in the "3D View" window of the 
£S devfee 24 based on the field values of the initial values of the nodes input to the scene graph data base 44. 

so fimpt Prep aration Unit 47 

[0120] The scrpt preparation unrt 47 has the functions of compiling, confirming the operation, and debugging the 
script prepared by the user using the text editor 426. 

55 Java Compiler 474 

101211 The Java compiler 474 compiles source programs of the script of the Java language stored in the^ scene graph 
ESJSwSE prepare the object program and outputs the same to the SGDB 44. In th,s embod^ent. when 
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the "Play" button of the "Conductor" window is depressed, the Java compiler 474 can automatically compile the source 

HE. "** is ' the f iles havin9 " iava " as extensions - to automaticai * p«w • n^££E! 

5 Java Emulat or 470 and Java Debugger 479 

fclfiL™* Java ^ ulat0 ' 4 ™ f° the ^va debugger 472 operate as the interpreter of a program described by the 
Java language and are used by the user for confirming the operation and debugging the script program TrS is It 

IsioT^ZTT^* ^f 0 " ° f the ° bjeCt Pr09ram ° f «** *"* in » e sce'ne^h dSa ba^^ 

$^££5£j^ 472 outputs the 51316 of * e Java emu,ator 470 at - emulation °p- afon *<* *» 



70 



Characteristic Functions of Co ntent Pre para tion Software Tnni-d 

' 5 Sr. ^ exp,anation f be 9 iven of Ihe substance of the processing characterizing the content preparation 

software tool 4 of the present embodiment. 

Operation Confirmation Function and Backup Manageme n t Fu nction /Browse Fmulator4sn Backup Mananw dfifi) 

20 IT- 24 - S* ? X S ained re,errin9 10 R9 - 4 to Rg - 6 ' " hen the user depresses the "Play" button displayed in the "Conduc- 
tor wmdow ,n *e screen of the display device 24 by the mouse 262 (Fig. 5, S301 . Fig. 6, S31 1 ) the br^er emulator 
460 analyzes >*. v RML content prepared up to this point of time and displays it on the display device 2^1° 
Hlustrated ,„ F,g. 6, the backup manager 466 also operates simultaneously and becomes able to Set up ,S tSue? 
TJe backup manager 466 successively stores the field values of the nodes expressing a moving object when a Zvtoa 
object etc. is cheked (Fig. 6. S223) (S224). Further, when the "Stop" button isTepresstd (Fig. 6. sS^^rrnTS 
rg mode rs returned to and the backup manager 466 restores the field values (Fig 6 S226) 

S£2L ^ WhS ^ e ? 3te ° f * e VRML COntent 31 ,he 01 * e confirmation of operation is stored by 

the backup manager 466. the user depresses the "Stop" button displayed in the "Conductor" window in the ram erf 
he display r device ,24 by the mouse 262. and the browser emulator 460 stops executing the V«E^T^25£ 

ZZTJX. h T "T?* K- the / ield at thS time <* the confirmation of operation a^dTeturn Sub 

stance of tte display of the object (model) of the window to that at the start of confirmation of operation 

wS«^i^T^J^ 0n and b3CkUP manaaemert ft«*on. the trouble of once storing the prepared 

^ J T J! ard , d,Sk ^ 214 6tC - 3nd then activatin9 ** VRML browse to confirm the operation Hke in 
nZfrl k * T T 06 10 Fi9 " 1 iS unnecessarv - add-on. the user can confirm the operation of the intern 
prepared by the work up to then at any time during the VRML content preparation work. 

File Automatic Pre paration Function (Java Compiler 474) 

™ JUS T^T^T" 5 .? " P,ay " button ° f the "Conductor window for confirmation of thesubstance of the 
« * ! T Java compner 474 automatically compiles source programs of the script, for example, files having 
■java as the extension, to automatically prepare an object program having ".class" as an extension fo? exanje 

Script Program Preparation anri np buooino Function (Text Editor A?K\ 
is [0128] The user can use the text editor 426 to prepare a source program of the script by the Java language or other 

sSpl "•""M" «» a*** *• wk» ol th. input/oulpul ollhe 8 cripl« : .and e na>l e stn«<lebugging«od,oflhe 
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Template Automatic Preparation F ^ion (Text F^pr APfi ) 



[0131] When the user sets the values of the input/output of the script node by an interactive manner the temoiatP 
preparation tool 428 prepares a template (template) of the source program of Ihi^l^T^^ ThTusS 
can use the text edrtor 426 to add the required medications to the template and thereby f^S!Z^!^ 



13 

3CCID: <EP 0895196A1J_> 



10 



15 



20 



EP 0 895 196 A1 

of the script for realizing the desired event. By this function, the user can eliminate the trouble of preparing all source 
programs of the script by the editor and in addition can prevent occurrence of simple coding mistakes. 

Ohjftct Display Function J Mnrtel Editing Tool 420) 

T01321 The model editing tool 420 enables normal display and display from different viewpoints 
[SH HgurT U isTvlew of an example of an object displayed in the "3D View" window of a GUI screen of the d,splay 

S ^The model editing tool 420 displays a three-dimensional perspective projection view (3D Perspective view) of 
Select SiSSd by the prepared graphic data in the "3D View" window in the GUI screen (Fig. 9). Below, thjsw I be 
2£tt2 ?D^ ew- window. In this stlte, if the user clicks and selects an object in the "3D View" window and c cks 
^eL one oTa "Rotate" button. "Move". "Navigate", or "Scale" button displayed in the ^^T^^ 
GUI screen shown in Fig. 1 0A to change the rotation, motion, or viewpoint motion operation mode h\fthe^ teft 

depresses the left button of the mouse 262 and drags on the inside of the "3D V.ew" w.ndow or c .cks on rt by the left 
SoTofthe mouse 262. the model editing tool 420 displays an image (object) obtained by rotat,ng or mov.ng the 
selected object (model) on the display device 24 in accordance with the mouse mode (rotation motion) and the opera- 
tier f oi ^e user with respect to the "3D View" window. When the user selects "Navigate (v.ewpo.nt motion) as the oper- 
aL mode thetode, Siting too. 420 uses the position in the "3D View" window clicked by the user as he v.ewpoint 
and dTsSs the image when view,ng the selected object from this viewpoint. Therefore. 

processing of the model editing tool 420. it is possible to view the object from vanous v.ewpo.nts. That .s. by us.ng th.s 
function it is possible for the user to view the object from various viewpoints. .',.„« 
EST Note *at when viewing an object from these dWerent viewpoints, it is preferable in <^ 
the operability that the object concerned be positioned at the center of the window. Therefore m the presenl I embodi- 
ment the processing for changing the viewpoint, the object concerned is automatically made to move to the center 

26 SlM] W ' F^er there is a POI (point of interest) mode in the operation modes of the mouse 262 as shown in Fig JI2. 
Sthe S selecis the objeci (modd: cone) in the "3D View" wind™ by pointing by »e mouse ^ 
ing tool 420 matches the viewpoint to the selected object (model) and displays the same at the center of the 3D V.ew 
window as shown in Fig. 1 1 and Fig. 14. 

Scaling Function of Object fModel Editing Tool 42Q) 

[0137] If making the operation mode of the mouse 262 the "scale" in the "Conductor" window r shown in ^ OA and. 
for example, the user moves the cursor while depressing a predetermined button tf^ 

ation foTintfructing a modification of the size of the object or data showing the s.ze after the <™*rf.ca*on f rom lh€ . key- 
boari 2S> «ie model editing tool 420 modifies the dimensions (size) of the object in accordance with the motion of the 
a^d the same. When the user releases the button of the mouse 262. the mod e. edrt.no. ^finally 

seisThe size of the model and modifies the content of the graphic data of the object so as to display the object of the 

size at the time of the final setting in the three-dimensional virtual space. 

[0138] Note that it is possible for the user to combine the modification of the mouse mode and the operation of the 
mouse 262 to make for example the routing editing tool 422 rotate and move the object and also enlarge (reduce) and 
Slay *e changed image irTthe "3D View" window. That is. this processing is processing effective when v.ew.ng an 

Son for instructing modification of the graphic data, the mode, editing tool 420 modifies the content of the graph.c data 
of the object (model) in accordance with the object displayed on the display device 24. 

p^n n. C pi a v a nri Setting Fusion of Sens o r Moris fModel Editing Tool 420 and Browser Emulator 460) 

[0140] A sensor is provided in the Primitive Bar illustrated in Fig. 10A and Fig. 10C for generating ar ^ent when the 
user clicks and points to an object in a virtua. space displayed in a window of the screen of the d.s ^vce 24_ When 
the f sensor generates an event, script routed to the sensor is executed, and the cursor moves outs.de the region (bound- 
ary box) of the sensor node, the script stops being executed. 

[0141] The sensor node region display and setting function is a function for conf .rm.ng and mod.fy.ng the range , of a 
valid region in a touch sensor given to an object for generating an event in accordance with an operation by the mouse 
262 etj a soLnd node outputtlng a sound in accordance with an operation of the mouse 262 etc.. or other three<l.men- 

[S^r^'eSSation will be made of the sensor node region display and setting function referring to Fig. 15. 
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[0143] S301 : The user clicks on an object in the "3D View" window using the mouse 262. 

[0144] S302: The model editing tool 420 operates in response to the above operation of the user. The model editing 
toot 420 selects the clicked object and causes the bounding box surrounding the selected object to blink. 
[0145] S303: Further, the user clicks on the "Sensor" tab of the "Conductor" window in the menu screen to designate 
5 for example a touch sensor (TouchSensor) or the like. 

[0146] S304: The model editing tool 420 adds a touch sensor etc. to the object in accordance with the operation of 
the user. 

[0147] In this initial stage, the range indicated by the bounding box indicating the selection of the object becomes the 
range of the valid region of the touch etc. 
io [0148] S305: Further, the user inputs a command for instructing a modification of the range of the valid region of a 
sensor from the keyboard 260 and data showing the range of the valid region after the modification or uses the mouse 
262 to point to the range of the valid region after the modification. 

[0149] S306: The model editing tool 420 modifies the range of the valid region of the sensor etc. and displays the 
range ol the valid region of the sensor etc. after the change by the bounding box in accordance with the operation of 
is the user. Note, in the following embodiments showing as the examples, the shape of the bounding line is represented 
as the box -Uke shape (i.e.. the bounding box), but, the shape of the bounding line is not limited to the bounding box-like 
shape, for mediating -out the embodiments of the present invention. 

[0150] The display function and scaling function mentioned above are possible also with respect to the following line 
(the bound v>g box) The user can make the model editing tool 420 perform rotation, motion, and enlarged or reduced 
20 display of the boundng box by the above operation. The model editing tool 420 sets the range defined by the bounding 
box modified by these operations as the range of the valid region of the sensor etc. after modification. 
[0151] S307 Further, the user depresses the "Play" button displayed in the "Conductor" window by the mouse 262 
for confirming the substance after the modification. 

[0152] S308 The browser emulator 460 operates in response to the operation of the user. The browser emulator 460 
25 executes the operation tor analyzing and displaying the content. Note that preferably, as explained in the above section 
"Confirmation Operation", the bacfcup manager 466 is also activated simultaneously with the browser emulator 460 so 
as to enable storage and restoration of the field values due to a moving object while confirming the VRML content by 
the browser emulator 460 

[0153] S309. S310 In a>e state with the browser emulator 460 operating, for example if the user moves the cursor of 
so the mouse 262 into the bounding box. the sensor generates the event and the script routed to the sensor is executed. 
If moving the cursor to the outsKle of the bounding box, the execution of the script is stopped. 
[0154] S31 1 : The executon of the VRML content by the browser emulator 460 is stopped by the user depressing the 
"Stop" button displayed w\ the "Conductor" window to return the operation of the content preparation software tool 4 to 
the preparation mode 

35 

Parallel View Function (Mode* Editing Tool 420) 

[0155] Figure 16 ts a view o* a pop-up menu displayed in the "3D View" window of the display device 24. Figure 1 7 is 
a view of the parallel view function 
40 [0156] ff the user d«*s on a predetermined button of the mouse 262 (right button of mouse) in the "3D View" window 
in a state where the browser emulator 460 is stopped, as shown in Fig. 16, the model editing tool 420 displays the pop- 
up menu in the "3D View" window, tf the user selects one item from the pop-up menu, the model editing tool 420 two- 
dimensionally displays a wde view of the object, a top view, or a view by a wire frame in the "Parallel View" window in 
the menu screen ol the display device 24. 

45 

Attention Function (Mode* Editing Tool 420) 

[0157] The attention function is a function used for confirming the shape of an object displayed in the "3D View" win- 
dow. It arranges and dtspla/s objects as the user sees them from a viewpoint designated in the content preparation soft- 
so ware tool 4 in the three-dimensional virtual space around one among the one or more objects selected by the user by 
the mouse 262 in the "3D View" window 

[0158] The model editing tool 420 displays one or more objects prepared in the "3D View Window" arranged in a 
three-dimensional virtual space 

[0159] As the menu screen displayed on the display device 24, that illustrated in Fig. 18 and Fig. 19 is shown. Figure 
55 20 to Fig. 22 are views of objects displayed in the "3D View" window as first to third examples showing the attention 
function. The objects shown in Rg. 18 to Fig. 19 are cones, but the objects displayed in Fig. 20 to Fig. 22 are embel- 
lished cones. 

[0160] The attention function will be explained with reference to the flow chart of Fig. 23. 
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[0161] S321 : The user clicks the "Navigate" button by the mouse 262 in the "Conductor" window as shown in Fig. 1 8 
to enter the viewpoint motion (Navigate) mode. 

[0162] S322: The user clicks on and selects a conical object by the left button of the mouse 262 as shown in Fig. 18 
or Fig. 20 in a "3D View" window displaying for example the conical object shown in Fig. 18 or the conical object and 
5 the embellished cylindrical object shown in Fig. 20. The model editing tool 420 surrounds the selected conical object by 
the bounding box to indicate that it has been selected. 

[0163] S323, S324: The user selects "Attention On" of the pop-up menu displayed by clicking the right button of the 
mouse 262 as shown in Fig. 18. Due to this, the model editing tool 420, as shown in Fig. 19 or Fig. 21, changes the 
background of the viewpoint position display panel to yellow and changes the direction of the line of sight so that the 
io selected object is at the center of the "3D View" window. The position of the viewpoint does not change, however, so 
the distance to the object remains the same. 

[0164] S325: When the user depresses the left button of the mouse 262 and drags around the object, as illustrated 
in Fig. 22, the position of the viewpoint and the direction of the line of sight of the object change accordingly, so it is pos- 
sible to view the object from various directions. That is, the model editing tool 420 changes the substance of the display 

rs of the "3D View" window in accordance with the designation of the user to an image of the conical object and cylindrical 
object as seen when using the position designated in the three-dimensional virtual space as the viewpoint. In this way, 
by using the attention function, the user can view not only the object itself rotated, but also the entire scene actually dis- 
played in the "3D View" window rotated in the three-dimensional virtual space and therefore can easily obtain a grasp 
of the entire image of the object. 

20 [0165] S326: When finishing viewing, the user, as shown in Fig. 19, selects "Attention OFF" in the pop-up menu. By 
this, the attention function of the model editing tool 420 is ended. 

Routing Editing Function: Setting of Type of Input Da ta (Routing Editing Tool 422) 

25 [0166] In VRML 2.0, it is possible to define the transfer of events between fields of the nodes by the route text such 

as the following: 

ROUTE NODE1.field1 TO NODE2.field2 

[0167] In this example, it is defined to send an event to a field given the field name (eventOut) of "fieldl" of the node 

given the node name (NodeName) of tt NODE1". In this route text, it is necessary that the data type (Data Type) preset 
30 for the file name (eventOut) of the side outputting the event and the data type (Data Type) preset for the file name 

(eventOut) of the side inputting the event match. 

[0168] When the user selects the field names of nodes on the side inputting an event, the routing editing function dis- 
plays just field names matching the data type preset for the field name of the node of the side outputting the already 
selected event as a pull down list (drop down list) in the ComboBox. By presenting to the user just the field names for 
35 which routing is possible in this way, the user can avoid the problem of describing mistaken route text and therefore the 
work of the describing the routing is made easier for the user. 

[0169] The routing editing function will be further explained with reference to Fig. 24 and Fig. 25 to Fig. 27. 
[0170] Figure 24 is a flow chart of the processing of the routing editing function. 

[0171] Figure 25 to Fig. 27 are views of the "Route" window showing an example of the routing editing function. 
40 [0172] The routing editing function, in other words, the processing for setting the type which may be input, will be 
explained with reference to Fig. 24. The following processing is executed by interactive manner of the routing editing 
tool 422 with the user. 

[0173] S331 : The "Route" window is opened by the user and the routing editing tool 422 judges if the mouse has been 
operated to display the pull down list (drop down list) of the node names (NodeName) or their field names (eventOut) 

45 of the upper side outputting events. 

[0174] S332: The routing editing tool 422 extracts the node names (NodeName) or their field names (eventOut) of the 
side outputting events which can be selected and displays the same as a pull down list (also called a ComboBox). 
[0175] S333: "TSI" for example is displayed by the routing editing tool 422 as the node name (NodeName) of the side 
outputting the event selected by the operation of the user to select from the menu using the mouse and "isActive" for 

so example is displayed by the routing editing tool 422 as the field name (eventOut) from the pull down list displayed as 
shown in Fig. 25. The data type (Date Type) preset for the selected field name, for example SFBool (Boolean value 
showing true or false, taking one of value of FALSE (0) or TRUE (1)), is displayed as reference in the right adjoining 
region of the field name (eventOut) by the routing editing tool 422. 

[0176] S334: Whether or not there has been a mouse operation by the user for displaying the pull down list of the 
55 node names (NodeName) of the lower side inputting the event is judged by the routing editing tool 422. 

[0177] S335: As shown in Fig. 26, for example, "PL1" and "TS1" are displayed by the routing editing tool 422 in the 

pull down list as node names (NodeName) of the input side of the event which may be selected. 

[0178] S336: The node name (NodeName) of the side inputting the event selected by the operation of the user to 
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select from the menu using the mouse 262 is displayed by the routing editing tool 422 from the pull down list shown in 
Fig. 26. 

[0179] S337: Whether or not there has been a mouse operation by the user for displaying the pull down list of the field 
names (eventln) of the lower side inputting the event is judged by the routing editing tool 422. 
s [0180] S338: As shown in Fig. 27, just the field names (eventOut) of the side inputting the event which can be selected 
are displayed in a pull down list by the routing editing tool 422. In this case, only the field names named "on", that is, the 
field names which match the data type preset for the field name of the node of the side outputting the event already 
selected by the user (in this case, which match SFBool), are displayed in the pull down list by the routing editing tool 
422. 

io [0181] S339: The field name (eventOut) of the node of the side inputting the event selected by the menu selection 
operation by the mouse from the pull down list shown in Fig. 27 is displayed by the routing editing tool 422 and the route 
text corresponding to the node names and the field names for transferring the event selected by the above menu oper- 
ation is generated at the routing editing tool 422. 

[0182] In this way, according to the routing editing function, since just the file names of the nodes matching the type 
is of the data of the event to be transferred between the fields of the nodes are displayed to the user, the user can select 
one of the file names displayed to set the type of the routing. Therefore, it becomes easy to set the type of data of the 
routing and mismatches of the types of data between nodes due to careless error etc. and other problems can be pre- 
vented. 

[0183] Routing is deleted by selecting the routing desired to be deleted and then depressing the "Delete" button. The 
20 routing editing tool 422 deletes the routing concerned in accordance with this operation. 

Script Editing Function (Text Editor 426) 

[0184] When the user modifies the value of the input/output of the script node ("eventln", "eventOut), the text editor 
25 426 automatically modifies the source program of the script corresponding to the script node so as to be compatible 
with the value of the input/output after the modification. 

File Scope Function (Scene Graph Editing Tool 424) 

30 [0185] When the user selects the VRML file to be edited in the "Conductor" window etc. of the menu screen of the 
display device 24, the scene graph editing tool 424 displays the nodes referred to by the selected VRML f Be to be edited 
in the "Scene Graph" window in the form of for example a hierarchical tree. The set of nodes referred to by the VRML 
file to be edited in this way will also be referred to as a "file scope". 

[0186] The scene graph editing tool 424 limits the nodes for routing, script preparation, and other editing to the file 
35 scope displayed in the "Scene Graph" window. Further, the content of the file scope and the nodes which may be edited 
are changed to the nodes referred to by the VRML file after modification in accordance with modification by the user of 
the VRML file to be edited. 

[0187] Note that the script editing function is valid throughout the nodes in the same VRML file (in file scale). When 
the user modifies the value of the inpuVoutput of the script node in the same VRML file ("eventln", "eventOut), the text 

40 editor 426 automatically changes the source programs of the script corresponding to the script node in the same VRML 
file (displayed in the same file scope) to be compatible with the value of the input/output after the modification so as to 
maintain the match of the descriptions between the script nodes (Inline management function). Further, in the VRML 
file, the name of the node must be unique, therefore the text editor 426 automatically changes the node name so that 
the name of the copied and pasted node becomes unique in the same VRML file so as to avoid overlapping of the node 

45 name (naming function at paste). 

Basic Method of P reparation of VRML Content 

[0188] An explanation will next be given of an example of the preparation of VRML content by the content preparation 
so software tool 4. 

[0189] Figure 28 is a view of an example of a conical object prepared by the content preparation software tool 4. 
[0190] An explanation will be made of the case of preparing the content (first content) for attaching a sensor to the 
conical object shown in Fig. 28 and making the cone bright or dark (turning ON/OFF the light) in accordance with point- 
ing to the sensor as a first specific example of preparation of content of three-dimensional virtual space (VRML content) 
55 using the content preparation software tool 4. 

[0191] The VRML content is prepared by the process illustrated in Fig. 29. That is, 

S401 : Preparing the graphic data [arranging the geometry node of the object {geometry node (cone)}] 
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S402: Adding the sensor [arranging the sensor node (TouchSensor) 

S403: Attaching a light node [arranging a node prescribed by VRML {common node (PointUght)} 
S404: Naming the node being routed 
S405: Setting the route 
5 S406: Confirming the operation 

[0192] Details of the process will be explained below: 

S401 Preparation of Graphic Data \ Arrangement of Geometry Nod e (ConeM 

10 

[0193] The user arranges the object in the three-dimensional virtual space (world) to construct the entire setup. The 
object which can be arranged in the three-dimensional virtual space as the object by using the content preparation soft- 
ware tool 4 is provided by for example a basic node of VRML 2.0 or library window. 

[0194] It ts also possible tor the content preparation software tool 4 to read the graphic data of an object prepared by 
is other modeling software by converting this to a file format compatible with VRML 2,0. 

[0195] When the user activates the content preparation software tool 4, the graphical user interface (GUI) 40 displays 
the GUI menu screen shown in Fig. 9 on the display device 24. When the user selects the item of "File/New" in "Con- 
ductor" window by using the mouse 262 etc., the model editing tool 420 of the content preparation software tool 4 newty 
prepares an empty world. 

20 [0196] The user performs the work for placing the conical object (cone) in the prepared empty world. When the user 
selects "Cone" from t>e "Geometry - tab of the "Conductor" window and clicks on the window for the graphic dataprep- 
aration (hereinafter descrtoed as the *3D View" window), the model editing tool 420 of the editing tool 42 prepares the 
graphic data of the object (cone) and displays the conical shape (cone) shown in Fig. 28 in the "3D View" window. Note 
that, at this time, t & also po&stte tor the user to use the attention function of the content preparation software tool 4 

25 to display the image vtsibte when moving the periphery of the object (cone) in the three-dimensional virtual space in the 
"3D View" window and cort*m the shape of the object (cone). 

S402: Addition o f Sensor Iffraogemenlof Sensor Node (TouchSensor)! 

30 [01 97] In order to add mcoon to the object in the three-dimensional virtual space or make this react with the operation 
of the user, it is necessary to add a sensor to the object, detect a constant condition for the operation of the user with 
respect to the object, and transm* the change thereof as the event to the other nodes. 

[01 98] Below, this w»D be expuuned by taking as an example the addition of the touch sensor (TouchSensor) for detect- 
ing a pointing operation by the mouse 262 with respect to the object. 
35 [0199] The sensor rs added to the object by placing the object in the selection state and then generating the sensor 
(TouchSensor). 

(1) First, when the use* ci<*s on the object (cone) in the "3D View" window, the model editing tool 420 selects the 
clicked object and makes the bounding box surrounding the selected object blink. 
40 (2) Further, when the us* ctafcs on the "Sensor" tab of the "Conductor" window, selects the touch sensor (Touch- 
Sensor) located at ff>e rightmost side of the "Sensor" tab, and clicks on the "3D View" window, the model editing 
tool 420 adds the touch sensor to the object and adds the data thereof to the graphic data of the object. Note that, 
at this stage, as mentioned above, it is also possible for the user to use the keyboard 260 or the mouse 262 to mod- 
ify the range of the vaW region of the sensor (TouchSensor). 

45 

[0200] Figure 30 is a view ol the "Scene Graph" window in the menu screen. 

[0201] The scene gra^> oc*tr*g tod 424 modifies the content of the display of the "Scene Graph" window in the menu 
screen as shown in Fig 30 n accordance with the addition of the touch sensor to the object. The user can confirm that 
the touch sensor (TouchSensor) was added to the object, in this example a cone, by referring to the "Scene Graph" win- 
so dow shown in Fig. 30. 

[0202] This example shows a case of adding a sensor (TouchSensor) to a simple object such as a cone, but it is also 
possible to add a sensor (TouchSensor) to a more complex object than a cone by a similar operation of the user. 

S403: Addition of C ommon Node (PointLiahti 

55 

[0203] In VRML 2.0. the operation is described by the flow of transmitting the event detected by the sensor (sensor 
node) to another node and having the node receiving the event modify its state. 

[0204] Below, this will be explained by taking as an example a case when a common node (PointLight) for making the 
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light blink is added as the node receiving the event. 

[0205] The common node (PointLight) lies in the "Common" tab of the "Conductor" window. However, when producing 
a light at the same position as the object while maintaining the illustrated display as it is, it becomes invisible, therefore 
it is necessary to move the viewpoint in advance. 
5 [0206] When the user makes the "3D View" window active and for example depresses a down arrow key i of the key- 
board 260, the model editing tool 420 displays the object seen from the position of a slightly away from the viewpoint in 
the "3D View" window. When selecting the common node (PointLight) in this state, the model editing tool 420 displays 
the object (cone) brightly as shown in Fig. 31 . 

io S404 Naming of Node to be Routed 

[0207] Next, the user carries out routing between nodes, for example, establishes correspondence from the sensor 
(TouchSensor) to the common node (PointLight). 

[0208] The "routing" means the connection of the two for transmitting the event among nodes, for example, from the 
ts sensor to the script. 

[0209] In order to perform this routing, it is necessary to first add a name (DEF name) to the sensor. 
[0210] Figure 32 and Fig. 33 are views of the work of naming the sensor node by the "Attribute" window. 
[021 1 ] The "Attribute" window is a window for modifying an attribute of the selected object. The name (DEF name) is 
added to the node by an operation with respect to the "Attribute" window. Here, this will be explained by taking as an 
so example a case where the user selects the sensor (TouchSensor) from the "Scene Graph" window and adds the DEF 
name (TS1. PL1) in the "Attribute" window. 

[021 2] As shown in Fig. 32, when the user designates the position of the "DEF name" in the "Attribute" window, types 
*TSr from the keyboard 260, and pushes the return key and, further, as shown in Fig. 33, selects the common node 
(PomtLight) from the "Scene Graph" window, types "PL1 and pushes the return key. the scene graph editing tool 424 
25 adds the DEF names "TS1" and "PL1 " to the sensor (TouchSensor) and the common node (PointLight), respectively. 
[0213] Further, when the user double clicks for example the "On" field of the common node (PointLight) of the 
"Attribute" window, the text editor 426 turns off the initial state of the light and adds the same to the graphic data of the 
object 

30 S405 Setting of Route 

[0214] Figure 34 is a view of an example of the "Route" window used for setting the routing between nodes. 
[0215] The user performs sets the routing so as to transmit the event generated in the sensor (TouchSensor; TS1) to 
the common node (PointLight; PL1). The content preparation software tool 4 sets the routing by the "Route" window 
35 shown in Fig. 34. 

[0216] In the "Route" window illustrated in Fig. 34, the upper "NodeName" position is used for setting the node name 
on the output side, while the lower "NodeName" position is used for setting the node name on the input side. Since the 
event is to click on the sensor (TouchSensor) and then turn the light on/off, when the user sets TS1 in "NodeName" on 
the output side and selects "isActive" for "eventOut", the format "SFBool" is displayed on the right side. Note that the 
40 display of "SFBool" on the right side indicates that the format of the event transferred in "isActive" is SFBool. 
[0217] The user sets PL1 in "NodeName" and sets "on" in "eventln" as the setting on the input side. 
[0218] In accordance wfth the setting by the user, the routing editing tool 422 modif ies the display of the "Route" win- 
dow of the display device 24 as shown in Fig. 34 . 

[0219] When the above setting is ended and the user depresses the "Add" button, the routing editing tool 422 estab- 
45 lishes correspondence between the sensor (TouchSensor) and common node (PointLight) for the routing and adds the 
route among nodes. 

S406: Confirmation of Operation 

so [0220] When the user depresses the "Play" button displayed on the display device 24, this is input to the graphical 
user interface (GUI) 40 of the content preparation software tool 4 and the operation of the VRML browser 308 is emu- 
lated by the browser emulator 460 of the content preparation software tool 4. Therefore, it is possible to confirm the 
VRML content at any timing during the work for preparation of the VRML content without activating the VRML browser 
308. 

£5 [0221] Further, when the user depresses the "Play" button displayed on the display device 24. the normal content 
preparation work is returned to. 

[0222] Below, the work for confirmation of the content will be explained. 

[0223] When depressing the "Play" button (button with right facing triangle mark) located at the bottom left of the 
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"Conductor" window by the mouse 262, the content preparation software tool 4 emulates the operation of the browser 
by the browser emulator 460 from the operation for preparation of the content (preparation mode) and then shifts to the 
operation for confirming the prepared content (simulation mode). 

[0224] When shifting to the simulation mode, the backup manager 466 stores the states of the nodes of the VRML 
5 content at this point of time and the viewpoint of the user. The browser emulator 460 then executes the VRML content 
and displays the same on the display device 24. When the user depresses the object (cone) displayed in the "3D View" 
window by the mouse 262 while the browser emulator 460 executes and displays the VRML content, the object is dis- 
played bright (Light ON) when depressed and the object is displayed dark (Light OFF) when not depressed. 
[0225] In this way, in the simulation mode, when the user clicks on the object (cone) by the mouse 262, the sensor 
70 (TouchSensor) attached to the object detects the click and the event is generated. The generated event is transmitted 
to the common node (PointUght) by the setting of the routing, the colon node (PointUght) changes the state, the object 
is turned ON, the event is generated by the similar flow even at the end of the click, and the common node (PointUght) 
turns off the light of the object. 

[0226] Further, when the user depresses the "Stop" button (button with square mark) of the "Conductor window by 
15 the mouse 262, the content preparation software tool 4 returns to the usual content preparation mode. 

[0227] When returning to the VRML content preparation mode, the backup manager 466 returns the state of the con- 
tent to the stored initial state at the point of time when it enters into the simulation mode and further returns the view- 
point of the user to the position at the point of time when it enters into the simulation mode. The model editing tool 420 
displays the graphic data of the initial state in the "3D View" window. 

20 

Storage of Prepared VRML Content 

[0228] When storing the file, when the user designates the file name by the "File/Save As" menu of the menu screen, 
the file input/output unit 462 records the file of the VRML content stored in the scene graph data base 44 in an external 
25 recording medium 28 via the hard disk drive 21 4 or the floppy disk drive 21 6 and the MO disk drive device 21 8. It is also 
possible for the user to open and view the file of the recorded content by the browser 308. 

[0229] As explained above, it will be understood that, when preparing and conf irming simple content for displaying 
the conical object bright or displaying it dark in accordance with a click by the mouse 262, it is possible to add the 
graphic data of the object, add a sensor, and add the routing by an interactive operation by the graphical user interface 
30 40 without programming by input of a complex character train command. 



Preparation of Complex Content 

[0230] Below, an explanation will be made of the case of preparing VRML content (second content) changing the color 
35 of the object when the mouse cursor comes over the object as a second specific example of preparation of content of 
three<limensional virtual space (VRML content) using the content preparation software tool 4. 
[0231 ] The above VRML content was comprised to transmit an event generated by a sensor (TouchSensor) attached 
to the object to another node [common node (PointUght)], but in VRML 2.0, script is interposed between the sensor and 
the other node and further complex motion can be realized. 
40 [0232] For example, in order to realize the second content by VRML 2.0, the color of the object (cone) is designated 
by the material attribute. This material attribute includes a plurality of fields. By setting diffuse color as the material 
attribute, the color of the object can be changed. In such a case, it is necessary to set the material attribute "diffuse 
color" in accordance with the generation of the event. In such a case, diffuseColor can be set by interposing the script. 
[0233] The work of preparing the second content becomes the routine illustrated in Fig. 35. That is, 

45 

S41 1 : Preparing the graphic data [arranging the geometry node (cone)] 
S412: Adding a sensor [arranging a sensor node (TouchSensor)] 
S413: Naming the node to be routed 
S414: Preparing the script 
so S41 5: Describing a program corresponding to the script (only debug code) 
S416: Setting a route to the script 
S417: Confirming the operation 

S418: Describing a program corresponding to the script (setting the color) 
S419: Setting the route to the material node 
55 S420: Confirming the operation 

[0234] Note that, the operation of steps 41 1 and 412 is the same as the operation of steps 201 and 202 described 
with reference to Fig. 29. so the explanation will be omitted. 
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[0235] Below, the work of the preparation of the second content will be explained. 

S413: Naming Node to be Routed 

s [0236] In VRML 2.0, in order to perform the routing, it is first necessary to add names. In the preparation of the first 
content, as mentioned above, names (TS1 and PL1) were added to the sensor (TouchSensor) and common node 
(PointLight). In the preparation of the second content, it is necessary to further name the material attribute. 
[0237] Figure 36 is a view of the "Appearance" window in the menu screen. 

[0238] In VRML 2.0, the material attribute is contained in the appearance node for setting an attribute such as the 
10 color added to the object and the bit map data. In the content preparation software tool 4, the "Appearance" window of 
the menu screen is used for the editing of the appearance (including material, texture, etc.) of the graphic data of the 
object selected in the "3D View" window. 

[0239] When giving a name to the material attribute of the object, the user first clicks on and selects the object by the 
mouse 262, selects the "Material" tab of the "Appearance" window shown in Fig. 36, and gives a name, for example, 
is "CONE1_MAT\ 

S414: Preparation of Script Node 

[0240] In VRML 2.0. there is a node for interfacing with the script program referred to as a script node. This script 
20 node is contained in the VRML file and enables the description of a complex operation by using a script described by 
for example the Java language. However, the script node has an interface function, so has a close relationship .with the 
opposing script for the interfacing and further enables definition of a plurality of inputs/outputs, therefore it becomes dif- 
ficult for the user to understand this. 

[0241] For this reason, in the content preparation software tool 4, there is & function referred to as a "Script Expert" 
25 for simplifying the description of the script. 

[0242] According to the "Script Expert" function, by defining the input/output of the script the template of the script 
program can be automatically generated and further also the input/output field can be edited by using the "Attribute" 
window. 

[0243] Figure 37 and Fig. 38 are views of an example of the interactive operation for preparing the script. Figure 38 
30 shows the interactive operation at the time of pop-up. 

[0244] When the user selects "Script/Expert" by the mouse 262 in the menu screen of the content preparation soft- 
ware tool 4, the template preparation tool 428 opens the interactive operation for preparing the script shown in Fig. 37 
and Fig. 38. 

[0245] In this interactive operation, "DEF" of the uppermost position is used for naming the script node used for the 
35 routing to the VRML file of the script The user inputs for example "SC1" to this position as the name of the script node. 
[0246] "OassName" of the position under "DEF" of the interactive operation is used for attaching a class name to the 
script of the Java language. The user attaches for example the temporary name "SCr to the script. 
[0247] Further, the user defines the input/output of the script node at the further lower position in the interactive oper- 
ation. In the preparation of the second content, the event generated by the sensor (TouchSensor) is input to the script, 
40 therefore the user changes "DataType" on the "eventin" side from the sensor (TouchSensor) to "SFBool" compatible 
with the format when transferring the event from the sensor (TouchSensor) and changes 1 ield name" to "inBool". 
[0248] The output of the sensor is transferred to the script for controlling the color of the material, therefore the user 
changes "DataType" on the "eventOut" side to "SFCoior" and changes "field name" to "outColor". 
[0249] The substance of the display of the interactive operation at the point of time when the user ends the set-up 
45 necessary for the preparation of the script node is as shown in Fig. 37. 

[0250] Further, when the user depresses the "OK" button at the bottom portion in the interactive operation shown in 
Fig. 37 by the mouse 262, the template preparation tool 428 prepares the script node and prepares the template of the 
script corresponcGng to the script node. 

50 S415: Description of Debug Code 

[0251] The content preparation software tool 4 further has a function of supporting and executing the description of 
the script by the Java language. That is, the template preparation tool 428 prepares the template of the program corre- 
sponding to the script node, outputs the same to the text editor 426, and supports the description of the script by the 
55 user. When using the content preparation software tool 4, the user can prepare the script by just editing and making 
modifications to the template prepared by the template preparation tool 428 by using the text editor 426, therefore the 
trouble required for the preparation of source program of the script may be made very small. 

[0252] Further, the user can use the Java compiler 474 to compile the script program prepared by the template prep- 
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aration tool 428 and the text editor 426. Accordingly, the trouble of stopping the content preparation software tool 4 and 
activating the compiler for the Java language whenever the source program of the script is prepared becomes unnec- 
essary. 

[0253] By the work up to this point of time, the newly defined template of the script is prepared and the editing of the 
5 script becomes possible. However, the template prepared by the template preparation tool 428 is only defined by the 
basic part of the input/output at this point of time and does not contain a program for actually realizing the event. Fur- 
ther, it is also possible for the user to edit the template by using the text editor 426 by the script description support and 
execution function to immediately prepare the script for modifying the color of the object, but it is desirable to confirm 
whether or not the prepared template actually operates by the debug code before this. 
10 [0254] Figure 39 is a view of the screen of the editor displayed by the text editor 426. 

[0255] In accordance with the operation of the user, the text editor 426 displays the template prepared by the template 
preparation tool 428 in the window for text editing of the display device 24 shown in Fig. 39. 

[0256] As shown in Fig. 39, the field name on the output side defined in the work heretofore is defined as the private 
variable (part of private SFColor m_outColor). In the initializeO method, the code for initializing this variable is embed- 
is ded A method such as _inBoolCB() is called up when there is an input event. A program operated by the input from the 
sensor (TouchSensor) is described in this method Lj nB oolCB()]. 

[0257] For example, when the code for viewing the value of the input from the sensor is added to the template, the 
following debug code is added to the JnBoolCBO method. 

20 Table 1 

System . out . print In ( "_±nBoolCB ( ) called : 

25 • +ev . getValue ( ) ) ; 



[0258] When this debug code is added and the user clicks on the right button and selects "Compile" from the pop-up 
30 menu, the Java compiler 474 is activated, the templates (source programs of scripts) to which the debug code was 
added are compiled, and the message in the compilation is displayed at the lower part of the editor. 
[0259] Note that, when the user depresses the "Play" button for confirmation of operation, the Java compiler 474 auto- 
matically compiles the source programs of the prepared script to prepare the object program, and the browser emulator 
460 executes the automatically prepared object program. Note, in this case, if an error is generated during the compi- 
35 lation. the browser emulator 460 does not execute the VRML content. 

[0260] When the compilation normally ends, the Java compiler 474 displays the word "Finished" on the screen of the 
editor When the compilation abnormally ends, a compilation error is displayed. When a compilation error is displayed, 
the user uses the text edrtor 426 to confirm again whether or not there is a thing error and amend the program (tem- 
plate), then executes the compilation again, whereby the error can be eliminated. 
40 [0261] At the time of the debugging by the Java debugger 472, the data indicated by the debug code is displayed in 
the ■Route" window, therefore, in this case, the user can understand the value of the data input from the sensor at the 
time of execution of the script. 

[0262] Figure 40 is a view of an example of the script "Attribute" window able to be used for the editing of the "eventln" 
and "eventOut" of the script node. Note that, for the editing of "eventln" and "eventOut of the script node, the "Script 
45 Attribute" window shown in Fig. 40 is used. 

[0263] When "eventln" or "eventOut of the "Attribute" window of the menu screen is depressed in a state where the 
user selects the script node, the "Script Attribute" window shown in Fig. 40 opens. 

[0264] When the "format" and "name" are set in the input field of the "Script Attribute" window and the "Add" button 
is depressed by the mouse 262, the text editor 426 adds a field to the script and further modifies the script node in the 
so scene graph data base 44. 

[0265] Further, when the user displays the input/output attribute of the script in a table in the "Script Attribute" window, 
designates a field, and depresses the "Delete" button by the mouse 262, the text editor 426 erases the description of 
the field from the script. 

[0266] Further, when modifying the "format" and "name" of the field of the script, the field of the script is erased once, 
55 then they are newly added. 

[0267] When the script node is modified by the above operation, the text editor 426 automatically modifies the source 

program of the script so as to be compatible with the state after modification. 

[0268] A concrete example of the automatic modification of a source program will be given next. 



22 



-DOCID: <EP 0S95196A1_)_> 



EP 0 895 196 A1 

[0269] For example, when the user displays the "eventOut" side in the "Script Attrtoute" window shown in Fig. 40, des- 
ignates the "TypeName" side as "SFBool". designates the "EventName" side as "outColor", and depresses the "Delete" 
button, the text editor 426 automatically erases the 10th row of the script shown in Fig. 39 (private SFColor 
m_outColor;) to reflect the modification. 

£ 

S416: Setting of Route to Script Node 

[0270] Figure 41 is a view of an example of the content of the "Route" window. 

[0271] As mentioned above, in order to make the script operate, routing is necessary. In the second script, in the 
io "Route" window shown in Fig. 41, the event generated by the sensor (TouchSensor) is routed to the script node, and 
the color of the object (cone) is modified. 

[0272] Figure 42 is a view of the substance of the "Java Console" window displayed by the browser emulator 460. 
[0273] When the cursor of the mouse 262 passes through the object (cone), if the routing is performed making the 
event generated by the sensor (TouchSensor) "isOver" and the field of the script node receiving the event "inBool" des- 
is ignated by using the "Script Expert" function, the Java debugger 472 displays for example a message of the content 
shown in Fig. 43 in the "Java Console" window. 

S417: Confirmation of Operation 

20 [0274] In the work of describing the debug code of step 415 (S415), the debug code is added to the script, therefore 
when the message shown in Fig. 43 is displayed in the "Java Console" window, the user can confirm whether or not the 
script operates without error. Further, in order to confirm the operation of the second content, the user may depress the 
"Play" button of the display device 24 in the same way as at the time of confirmation of operation of the first content. 
[0275] Further, when there is a necessity for displaying the value of the output of the script, when the user selects the 

25 "View/Java Console" menu of the menu screen, the browser emulator 460 displays the "Java Console" window shown 
in Fig. 43. 

[0276] Further, when the user depresses the "Play" button of the menu of the display device 24, the browser emulator 
460 emulates the operation of the VRML browser 308 and displays the object (image) of the three-dimensional virtual 
space indicated by the VRML content in the "3D View" window. Further, when the user moves the cursor in the "3D 
so View" window to the object by the mouse 262, as shown in Fig. 41 , the Java debugger 472 displays the message "true" 
in the "Java Console" window, while when the user moves the cursor away from the object, the message "false" is dis- ~ 
played. 

[0277] The substance of the display of the "Java Console" window shown in Fig. 43 shows that, when the cursor of 
the mouse 262 comes to the object, the sensor (TouchSensor) attached to the object detects this state and generates 
35 an event, this is transmitted to the script node, and the script node receives the event. The display in the "Java Console" 
window is carried out by the execution of system.out.println() in the method. 

[0278] Note that, even in a case when the cursor of the mouse 262 is moved away from the object, the event is sim- 
ilarly transmitted and the result of the operation is displayed in the "Java Console" window. 

[0279] When the user debugs the script, as mentioned above, it can confirmed whether or not the event is being nor- 
40 mally transmitted to the script by adding the debug code to the script 

S418: Description of Program Corresponding to Script 

[0280] Figure 44 is a view of an example of the script obtained by adding codes for changing the color of the object 
45 (cone). 

[0281] The color of the object is modified by writing a value in the field of the output side of the script shown in Fig. 
44 (variable name "m_outColor") and routing to the material attribute. In order to add codes for changing the color of 
the object to the script, the following codes are added to the method LmBodCBOL 

50 
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Table 2 

float r[] = (l.Of. O.Of, O.Of); 

float g[] * (O.Of, l.Of, O.Of); 

If ( cv . getValue ( ) ) m_ outColor . setValue ( r ) ; 

else m_outColor . setValue ( g ) ; 



[0282] By the addition of these codes, in the emulation operation by the browser emulator 460, when the cursor of the 
mouse 262 enters the object. ev.getValueO of the code becomes "true" and red is output from the script (SC1), while 
when the cursor leaves it. ev.getValueO of the code becomes "false" and green is output from the script. 

so S419: Setting of Route to Material Node 

[0283] In order to actually change the color of the object (cone), it is necessary to perform routing from the script node 

to the material attribute. . 
[0284] Figure 36 is a view of the substance of the display of the case when "outColor" of the script program (SCI ) is 
25 routed to "diffuseColor" of the material attribute (CONE1 — MAT) in the "Route" window. 

[0285] When the user routes "outColor" of the script node (SC1 ) to "diffuseColor" of CONE1_MAT in the "Route" win- 
dow the flow of the event of the propagation of the event from the sensor (TouchSensor) to the script (SC1) together 
with' the routing set heretofore and further the propagation of the event from the script node to the material attribute 
(CONE1_MAT) is completed. 

30 [0286] When the above work is ended, if the user depresses the "Play" button of the "Conductor" window and moves 
the cursor of the mouse 262 onto the object (cone), the color of the object becomes red, while when it moves the cursor 
away from the object, the color of the object becomes green. 

[0287] In the same way as when confirming the operation of the first content, the backup manager 466 holds the initial 
state of the content and the viewpoint of the user at the start of the confirmation of the operation. When the user 
35 depresses the "Stop" button and the operation of the browser emulator 460 is ended, the model editing tool 420 
restores and displays the content of the initial state held in the backup manager 466 in the "3D View" window in a state 
when it is seen from the viewpoint of the user at the start of the confirmation of the operation. 
[0288] For example, when the substance of the display of the initial state of the VRML content at the start of the con- 
firmation of the operation is as shown in Fig. 28 and the substance of the display of the content at the end of the con- 
firmation of operation is as shown in Fig. 31 , the model editing tool 420 returns the display of the object (cone) in the 
"3D View" window to the content shown in Fig. 28 based on the initial state held by the backup manager 466. 
[0289] The operation of the content in the confirmation of operation explained here is as follows. 
[0290] When the cursor moves to the object, the sensor (TouchSensor) attached to the object detects this and the 
event is generated. The generated event is transmitted to the script node by the setting of the routing, and the scnpt 
node executes the method. During the method, when receiving the input event (true), red is set in the output field, the 
color written in the output field is set for the material attribute of the object (cone) by the routing, and the color of the 
object (cone) in the three-dimensional virtual space becomes red. Similarly, when the cursor is moved away from the 
object (cone), the event (false) is transmitted from the sensor (TouchSensor) to the script node, and the method sets 
green in the field of output and changes the object (cone) to the green color. 



so 



Clicking of Object (Cone^ to Make Sound 



[0291 ] An explanation will now be made of the case of preparing a VRML content (third content) of producing a sound 
when clicking on the object (cone) by the mouse 262 as a third specific example of preparation of the content of three- 
55 dimensional virtual space (VRML content) using the content preparation software tool 4. 
[0292] Below, an explanation will be made of the work for preparation of the third content. 

[0293] In VRML 2.0, it is possible to use a sound node to output a sound. The content preparation software tool 4 has 
the function of dragging and dropping a sound node from the sound library to add the sound node to the world. 



24 



SDOCID: <EP 089S196A1 J_> 



EP 0 895 196 A1 

[0294] The work for preparing the third content is carried out by the following process illustrated in Fig. 45: 

S431 : Preparing the graphic data of the object (cone) [arranging the geometry node (cone)] 
S432: Adding a sensor [arranging a sensor node (TouchSensor)] 
5 S433: Arranging a sound node 

S434: Confirming the operation 
S435: Setting and routing the AudioClip node 
S436: Confirming the operation 

io [0295] The operation of step 431 and step 432 is the same as with preparation of the first content and preparation of 
the second content, so the explanation will be omitted. Here, a name "TSl" is attached to the sensor (TouchSensor). 
Next, the operation of the default of the sound node is confirmed, the modification of the attribute and routing are carried 
out, and the sound is confirmed by clicking on the object. 

is S433: Arrangement of Sound Node 

[0296] Figure 46 is a view of the "Scene Graph" window and the "Attribute*' window when arranging the sound node. 
[0297] In VRML, to output a sound, it is necessary to arrange a sound node. The content preparation software tool 4 
is constituted so as to add a sound node by the user clicking on the first "Sound" tab of the "Resource Library" window 
20 shown in Fig. 9 by the mouse 262 to open the sound library and dropping a sound node from the sound library. 

[0298] First, the user views the "3D View" window and confirms that nothing has been selected. When a certain object 
is selected, the user selects "Unselect" by the pop-up menu of the "Scene Graph" window shown in Fig. 46 to instruct 
the release of the selection to the model editing tool 420. 

[0299] Further, the user confirms that the object (cone) is visible in the "3D View" window. When it selects "Classic" 
25 from the sound library of the " Resource Library" window and drops this into the "3D View" window, the model editing tool 
420 adds the sound node to the graphic data of the object. 

[0300] When the user clicks on the tree displayed in the "Scene Graph" window, the scene graph editing tool 424 dis- 
plays the content shown in Fig. 47 and indicates to the user that the sound node has been added. 
[0301] In the sound node, it is possible to designate the region of the sound by a "maxBack", "maxFront", or other 
30 field. Note that, in the default state when dropped from the library, "maxBack" = "maxFront" = 1 0 is set so that the sound 
is output when the cursor of the mouse 262 enters the region. 

S434: Confirmation of Operation 

35 [0302] The user can confirm the sound node by depressing the "Play" button. In the content preparation software tool 
4, the cursor of the mouse 262 is set to already enter the region of the sound immediately after the sound node is 
dropped, therefore when the user depresses the "Play" button, the set sound (classic music in this example) is output. 
[0303] Further, in the content preparation software tool 4, the "spatialize" field of the sound node is set to "TRUE" in 
the default state. When moving (navigating) in the three-dimensional virtual space by using the mouse 262 in the "3D 

40 View" window, the magnitude of the sound and the left and right pans change in accordance with the position of the 
cursor of the mouse 262. 

[0304] Next, when the user depresses the "Stop" button of the display device 24 to return to the preparation mode 
and selects "Sound" in the "Scene Graph" window, the model editing tool 420 displays a blinking bounding box showing 
the region where the sensor (TouchSensor) generates the event outputting the sound around the object (cone) shown 
45 in the "3D View" window on the left side and the "ParallelView" window on the right side as shown in Fig. 47, so the user 
can visually confirm the region of the sound. 

[0305] Further, when the user selects "Parallel View/Tip View" from the pop-up menu of the "3D View" window, the 
model editing tool 420 three-dimensionaliy displays the image of the object (cone) from the front surface in the "3D 
View" window on the left side of Fig. 47 and two-dimensionally displays the image of the object (cone) seen from above 

so in the "ParallelView" window on the right side. 

[0306] When the user moves the viewpoint so as to see the whole object and bounding box in the "ParallelView" win- 
dow shown in Fig. 48, if it depresses the shift key of the keyboard 260 and the left button of the mouse 262 (not illus- 
trated) and drags the "ParallelView" window in the downward direction, the model editing tool 420 displays the image of 
the object from a far away viewpoint in the "ParallelView" window. 

55 [0307] When the user pushes the "Play" button and then moves the cursor of the mouse 262 in the "3D View" window, 
a sound is output when the cursor enters the region indicated by the bounding box shown in Fig. 46. The output of the 
sound is stopped when the cursor leaves this region. 

[0308] Figure 48 is a view of an example of modification of the size of the region for outputting the sound shown in 
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Fig. 47. 

[0309] In the content preparation software tool 4, it is possible to numerically designate the region indicated by the 
bounding box in the "Attribute" window or switching the mouse mode oh the menu screen shown in Fig. 9, as shown in 
Fig. 47, so as to move, rotate, and scale this region by using the mouse. 

5 

S435: Setting and Routing of AudioClio Node 

[0310] When adding the sound node by the above work, the sound is automatically output when the cursor of the 
mouse 262 enters into the region of sound indicated by the bounding box in Fig. 34 and Fig. 35. This is related to the 

io setting of "startTime" = O/'stopTime" = 0, and "loop" = TRUE" of the AudioClip node attached to the sound node. 
[0311] In VRML 2.0, "startTime" of the AudioClip node represents the start time and outputs sound in the case of 
"startTime" >= "stopTime". Further, it is also possible to repeatedly output the sound by setting "loop" = "TRUE". Fur- 
ther, in Fig. 47 and Fig. 48, when modification is made so as not to give off a sound until the region indicated by the 
bounding box is clicked by the mouse 262, "startTime" = -1 is set. Further, in order to stop the output of the sound when 

75 the region indicated by the bounding box is clicked, the clicked time is assigned for "startTime". 

[031 2] Figure 49 is a view of an example of the modification of AudioClip node and the routing from the sensor (Touch- 
Sensor) to the AudioClip node. 

[031 3] For example, in order to set the stopping of the output of the sound when the region defined by the bounding 
box is clicked, as shown in Fig. 48, the user must select the first "AudioClip" tab of the "ResourceUbrary" window, attach 
20 a name "AC1" to the AudioClip node, and further perform the routing from "touchTime" of the sensor (TouchSen- 
sor;TS1 ) to "startTime" of the AudioClip node in the "Route" window. 

S436: Confirmati on of Operation 

25 [031 4] When the user depresses the "Play" button by the mouse 262 and clicks the object (cone) displayed in the "3D 
View" window, the output of the sound is started by the browser emulator 460. 
[031 5] The operation of the third content is as follows. 

[0316] When the user clicks on the object (cone) in the "3D View" window by the mouse 262. the event "touchTime" 
is generated from the sensor (TouchSensor) attached to the object. In this event, the clicked time (in VRML 2.0, the rel- 
30 ative time from 00:00:00 GMT January 1 , 1 970) is transferred to "startTime" of AudioClip, "startTime" is set, and the out- 
put of the sound is commenced. Note that, in this example, the loop field of the AudioClip node is set to "TRUE", 
therefore the sound (music) is repeatedly reproduced and output. 

[0317] With this setup, the output of the sound cannot be stopped unless the cursor is moved to the outside of the 
region of the sound, therefore when stopping the output of the sound, the user must use the text editor 426 etc. to mod- 

35 ify the program so as to stop the output of the sound under predetermined conditions. 

[0318] Note that, in the embodiment, the explanation was given by taking as an example the case of preparing the 
graphic data of a conical object, attaching a touch sensor to the graphic data, and modifying the common node (light) 
or color or outputting a sound, but the content preparation software tool 4 of the present embodiment is not limited to 
this. Needless to say the VRML content can be prepared by using all nodes supported by VRML 2.0. 

40 [031 9] Further, the content preparation software tool 4 can handle languages for describing three-dimensional virtual 
space other than VRML by suitable modif ication. 

Effect of the Invention 

45 [0320] According to the present invention, with the attention function, the user can obtain a display of a desired object 
and view the object from any viewpoint. The attention function of the present invention is good in interaction efficiency 
and high in operability. 

[0321] Further, according to the present invention, the following effects are obtained. 

[0322] According to the graphic data generation apparatus, graphic data generation method and medium of the same 
so of the present invention, the totally and systematic work of the generation of the graphic data showing the shape of the 
graphic of the object in the virtual space, the position in the three dimensional space and others, the programing of the 
event (script) in the virtual space, and the corresponding work (routing) of the pointing to the model and the initiation 
(start) of the script, can be carried out. 

[0323] According to the graphic data generating apparatus, graphic data generation method, and medium of the same 
55 of the present invention, the model, script, routing, and other result of work can be immediately confirmed. 

[0324] Further, according to the graphic data generating apparatus, graphic data generation method, and medium of 
the same of the present invention, the preparation of software enabling operations in the three<iimensional virtual 
space to be performed by an interactive manner is made easy. 
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[0325] Further, according to the graphic data generating apparatus, graphic data generation method, and medium of 
the same of the present invention, the shape of a three<iimensional object displayed in the virtual space can be cor- 
rectly grasped by a two-dimensional screen display. 

[0326] Further, according to the graphic data generating apparatus, graphic data generation method, and medium of 
5 the same of the present invention, it is possible to visually easily set the range of the valid region of a sensor generating 
an event in accordance with an operation with respect to the object and to confirm the valid region of the set sensor and 
it is easy to confirm the operation of the event generated in accordance with an operation with respect to the sensor. 

INDUSTRIAL APPLICABILITY 

10 

[0327] The graphic data generating apparatus, graphic data generation method, and medium of same of the present 
invention can be used widely as authoring toots for content in a three-dimensional graphic description language 
expressing an object in a three-dimensional virtual space. 

75 LIST OF REFERENCES 

[0328] 

1... net work system 

20 

10... in house net work 

100... hard disk drive 
102. .. server device 

25 

12... Internet system 
14... Internet provider 
16... ISDN net 

30 2... client (subscriber) system 

20... computer 
24... display device 
26... input device 

35 

260... keyboard 
262... mouse 

28... recording medium 

40 

280... floppy disk 
282... MO disk 

4... content preparation software tool 

45 

40... graphical user interface unit (GUI) 
42... editing tool 

420... model editing tool 
so 422... routing editing tool 

424... scene graph editing tool 
426... text editor 

44... scene graph data base 
55 46... working tool 

460... browser emulator 
462... file input/output unit 
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464... file scope management unit 
466... backup manager 

47... script preparation unit 

5 

470... Java emulator 
472... Java debugger 
474... Java compiler 

10 Claims 

1 . A graphic data generating apparatus comprising: 

a displaying means (31, 40) for displaying a three-dimensional object in an editing window; 
75 an instructing means for giving an operation instruction for an object displayed by said displaying means; and 

an attention processing means (420), wherein 
the attention processing means: 

enters an attention mode in response to a first predetermined operation instruction, 
selects an object selected by the instructing means, and 
20 displays the selected object moved to the center of the editing window to enable the selected object to be 

viewed from any viewpoint. 

2. A graphic data generating apparatus as set forth in claim 1 , wherein the attention processing means ends its oper- 
ation in response to a second predetermined operation instruction. 

25 

3. A graphic data generating apparatus as set forth in one of claims 1 and 2, wherein the attention processing means 
is executed by an editing means for preparing content. 

4. A graphic data generating apparatus as set forth in any one of claims 1 to 3, wherein said object is described by a 
30 VRML, that is, a three-dimensional graphic description language. 

5. A graphic data generating method which prepares content in a three-dimensional virtual space by an interactive 
manner with a displaying means displaying a three-dimensional object in an editing window, 

35 said graphic data generating method which: 

changes to an attention mode in response to a first predetermined operation instruction, 
selects an object in accordance with a selection, and 

displays the selected object moved to the center of an editing window to enable the selected object to be 
viewed from any viewpoint. 

40 

6. A graphic data generating method according to claim 5, wherein the attention mode is ended in response to a sec- 
ond predetermined operation instruction. 

7. A medium for mediating a program which prepares content in a three-dimensional virtual space by an interactive 
45 manner with a displaying means displaying a three-dimensional object in an editing window, 

said medium having a program which: 

changes to an attention mode in response to a first predetermined operation instruction, 
selects an object in accordance with a selection, and 
so displays the selected object moved to the center of an editing window to enable the selected object to be 

viewed from any viewpoint. 

8. A medium as set forth in claim 7, wherein said program is executed in a computer system. 

55 9. A medium as set forth in claim 7, wherein said program is transferred through a network including a server appa- 
ratus. 
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